Modeling MPI Communication Performance on SMP Nodes: Is it Time to Retire the Ping Pong Test
Modeling MPI Communication Performance on SMP Nodes: Is it Time to Retire the Ping Pong Test
复制标题
在 SMP 节点上对 MPI 通信性能进行建模：是时候淘汰 Ping Pong 测试了
DOI：
10.1145/2966884.2966919
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Philipp Samfass
中科院分区：
文献类型：
--
作者：
W. Gropp;Luke N. Olson;Philipp Samfass
通信的“邮政”模型[3，8] T = α + βn，用于在延迟为α和带宽为1/β的两个进程之间发送n字节的数据，可能是并行计算中最常用的通信性能模型。该性能模型常用于开发和评估高性能计算中的并行算法，并且在首次提出时是一个有效的模型。因此，为了测量模型中的这些参数，已经开发了许多“乒乓”通信测试。然而，随着连接到单个（或几个）网络接口的多核节点的出现，该模型已变得与现代硬件不匹配。在本文中，我们展示了一个简单的三参数模型，更好地捕捉当前的并行计算系统的行为，并证明了它的准确性在几个系统。为了支持这个模型，我们称之为最大速率模型，我们开发了一个开源基准1，可用于确定模型参数。
The "postal" model of communication [3, 8] T = α + βn, for sending n bytes of data between two processes with latency α and bandwidth 1/β, is perhaps the most commonly used communication performance model in parallel computing. This performance model is often used in developing and evaluating parallel algorithms in high-performance computing, and was an effective model when it was first proposed. Consequently, numerous tests of "ping pong" communication have been developed in order to measure these parameters in the model. However, with the advent of multicore nodes connected to a single (or a few) network interfaces, the model has become a poor match to modern hardware. In this paper, we show a simple three-parameter model that better captures the behavior of current parallel computing systems, and demonstrate its accuracy on several systems. In support of this model, which we call the max-rate model, we have developed an open source benchmark1 that can be used to determine the model parameters.