Toward adjoinable MPI
Toward adjoinable MPI
复制标题
迈向可连接的 MPI
DOI：
10.1109/ipdps.2009.5161165
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
U. Naumann
中科院分区：
文献类型：
--
作者：
J. Utke;L. Hascoët;P. Heimbach;C. Hill;P. Hovland;U. Naumann
自动微分是从以计算机程序形式给出的数值模型中获得解析导数的主要手段。因此，它是许多计算科学和工程领域中必不可少的生产力工具。通过源变换使用伴随(也称为逆)模式计算梯度是自动微分的一种特别有益的用法，但也是一种挑战。到目前为止，只有用于MPI程序的伴随区分的特别解决方案可用，迫使自动区分工具用户对并行通信数据流和依赖关系进行推理，并手动开发伴随通信代码。以交流图为模型，我们刻画了与最常用的交流习语相邻的主要问题。我们提出了覆盖这些习惯用法的解决方案，并考虑了MPI实施、MPI用户和MPI感知程序分析的后果。麻省理工学院的大气环流模型作为一个用例来说明我们方法的可行性。
Automatic differentiation is the primary means of obtaining analytic derivatives from a numerical model given as a computer program. Therefore, it is an essential productivity tool in numerous computational science and engineering domains. Computing gradients with the adjoint (also called reverse) mode via source transformation is a particularly beneficial but also challenging use of automatic differentiation. To date only ad hoc solutions for adjoint differentiation of MPI programs have been available, forcing automatic differentiation tool users to reason about parallel communication dataflow and dependencies and manually develop adjoint communication code. Using the communication graph as a model we characterize the principal problems of adjoining the most frequently used communication idioms. We propose solutions to cover these idioms and consider the consequences for the MPI implementation, the MPI user and MPI-aware program analysis. The MIT general circulation model serves as a use case to illustrate the viability of our approach.