Message passing on data-parallel architectures
Message passing on data-parallel architectures
复制标题
数据并行架构上的消息传递
DOI：
--
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
John Douglas Owens
中科院分区：
文献类型：
--
作者：
Jeff A. Stuart;John Douglas Owens
本文探讨了在使用数据并行处理器上实施消息传递接口的挑战。我们使用基于睡眠的投票系统来存储和检索消息，我们的方法可以通过运行具有不同通信要求的应用程序套件。根据应用程序的不同，指示该间接费用的位置，我们将其包括在芯片组和驱动程序中的创新，该开销将得到缓解，并提供与典型的基于CPU的MPI实现的相似性能沟通。
This paper explores the challenges in implementing a message passing interface usable on systems with data-parallel processors. As a case study, we design and implement the “DCGN” API on NVIDIA GPUs that is similar to MPI and allows full access to the underlying architecture. We introduce the notion of data-parallel thread-groups as a way to map resources to MPI ranks. We use a method that also allows the data-parallel processors to run autonomously from user-written CPU code. In order to facilitate communication, we use a sleep-based polling system to store and retrieve messages. Unlike previous systems, our method provides both performance and flexibility. By running a test suite of applications with different communication requirements, we find that a tolerable amount of overhead is incurred, somewhere between one and five percent depending on the application, and indicate the locations where this overhead accumulates. We conclude that with innovations in chipsets and drivers, this overhead will be mitigated and provide similar performance to typical CPU-based MPI implementations while providing fully-dynamic communication.
结合数据局部性的图形集群计算统一系统架构
影响因子：
5.2
作者：
Müller;S. Frey;M. Strengert;C. Dachsbacher;T. Ertl
通讯作者：
T. Ertl