MPI Detach - Asynchronous Local Completion
MPI Detach - Asynchronous Local Completion
复制标题
MPI Detach - 异步本地完成
DOI：
10.1145/3416315.3416323
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
T. Kuhlen
中科院分区：
文献类型：
--
作者：
Joachim Protze;Marc;A. C. Demiralp;Matthias S. Müller;T. Kuhlen
当目标是大规模并行计算时，由于网络延迟、同步和负载不平衡引起的等待时间是高并行效率的主要对手。通过计算隐藏延迟的常见方法是使用非阻塞通信。在存在一致的负载不平衡的情况下，同步成本只是负载不平衡的可见症状。在OpenMP、TBB、OmpSs或C++20协程中的任务分配方法承诺公开更高程度的并发性，这些并发性可以分布在可用的执行单元上，并显着增加负载平衡。可用的MPI非阻塞功能不能无缝集成到这样的任务并行化中。在这项工作中，我们提出了一个超薄的MPI接口扩展，允许无缝集成的非阻塞通信与异步执行的概念，在OpenMP和C++。
When aiming for large scale parallel computing, waiting time due to network latency, synchronization, and load imbalance are the primary opponents of high parallel efficiency. A common approach to hide latency with computation is the use of non-blocking communication. In the presence of a consistent load imbalance, synchronization cost is just the visible symptom of the load imbalance. Tasking approaches as in OpenMP, TBB, OmpSs, or C++20 coroutines promise to expose a higher degree of concurrency, which can be distributed on available execution units and significantly increase load balance. Available MPI non-blocking functionality does not integrate seamlessly into such tasking parallelization. In this work, we present a slim extension of the MPI interface to allow seamless integration of non-blocking communication with available concepts of asynchronous execution in OpenMP and C++.