OAC Core: Small: Collaborative Research: Scalable Run-Time for Highly Parallel, Heterogeneous Systems

OAC 核心：小型：协作研究：高度并行、异构系统的可扩展运行时

• 批准号: 1909015
• 负责人: George Bosilca
• 金额: $ 25万
• 依托单位: University of Tennessee Knoxville
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-07-01 至 2023-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1909015&HistoricalAwards=false
• 关键词: OAC; Core; Small; Collaborative; Research

Supercomputing has become an essential tool in many scientific fields, including advances in engineering and medicine, and contributes to national security. Progress in many areas depends on continued improvements in the performance of supercomputers and their usability. Communication between processes is a critical component of this effort and is the target of this project. This project departs from the traditional communication protocols. Rather, the project focuses on providing middle ground solutions between hardware and software. This approach potentially reduces communication overheads and better matches the functionality of the communication library to the capabilities of modern communication adapters and also improves the match between the requirements of modern parallel computing frameworks and applications. By improving the communication capabilities of computational platforms, this project will promote faster and more flexible communication capabilities and will improve the time to completion of scientific applications. It, therefore, increases the scientific throughput of existing and future cyberinfrastructure platforms. The research and educational outcomes of this project are closely related, resulting in highly trained new generations of researchers and engineers leading to a more efficient and globally competent workforce. Therefore, this project aligns with the NSF's mission to promote the progress of science and to advance national prosperity and welfare through science, and serves the national interest. This project brings together a multidisciplinary team and aims at breaking away from the limitation of standards such as Message Passing Interface and pointing the way for handling the needs of future computational frameworks and high-end systems. To this end the project (1) designs and implements a communication library with new communication primitives to enable fast coordination with no serial bottleneck, to manage irregular, fine grain communication, and to provide new efficient synchronization mechanisms; (2) demonstrates the value of this library by using it to accelerate multiple task-based runtimes (Legion, PaRSEC) and communication libraries (MPI and GasNET); (3) demonstrates the value of hardware support by porting key components to a programmable NIC; and (4) delivers improvements and extensions to mainstream communication libraries to provide the new functionality. This work puts a special emphasis on emerging programming models, such as Legion or PaRSEC, and on emerging application domains, such as graph analytics. It aims at an orthogonal design where different mechanisms for associating producer buffer with consumer buffer can be composed with different mechanisms for synchronizing producer and consumer; and where mechanisms can be specialized so as to allow efficient hardware support.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

超级计算已经成为许多科学领域的重要工具，包括工程和医学的进步，并有助于国家安全。许多领域的进展取决于超级计算机性能及其可用性的持续改进。过程之间的通信是这项工作的关键组成部分，也是本项目的目标。该方案脱离了传统的通信协议。相反，该项目侧重于提供硬件和软件之间的中间解决方案。这种方法潜在地减少了通信开销，并且更好地将通信库的功能与现代通信适配器的能力相匹配，并且还改进了现代并行计算框架和应用程序的要求之间的匹配。通过提高计算平台的通信能力，该项目将促进更快和更灵活的通信能力，并将缩短完成科学应用的时间。 因此，它增加了现有和未来网络基础设施平台的科学吞吐量。该项目的研究和教育成果是密切相关的，导致训练有素的新一代研究人员和工程师导致更高效和全球竞争力的劳动力。因此，该项目符合NSF的使命，即通过科学促进科学进步和国家繁荣和福利，并为国家利益服务。该项目汇集了一个多学科团队，旨在摆脱消息传递接口等标准的限制，并为处理未来计算框架和高端系统的需求指明方向。为此，本项目（1）设计并实现了一个具有新通信原语的通信库，以实现无串行瓶颈的快速协调，管理不规则的细粒度通信，并提供新的高效同步机制;（2）通过使用该库来加速多个基于任务的运行时，展示了该库的价值（Legion、PaRSEC）和通信库（MPI和GasNET）;（3）通过将关键组件移植到可编程NIC来展示硬件支持的价值;以及（4）对主流通信库进行改进和扩展以提供新功能。这项工作特别强调新兴的编程模型，如军团或PaRSEC，以及新兴的应用领域，如图形分析。该奖项旨在通过正交设计，将生产者缓冲区与消费者缓冲区相关联的不同机制与同步生产者和消费者的不同机制相结合，并将机制专门化，以实现有效的硬件支持。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Callback-based completion notification using MPI Continuations

使用 MPI Continuations 的基于回调的完成通知

• DOI: 10.1016/j.parco.2021.102793
• 发表时间: 2021
• 期刊: Parallel computing
• 影响因子: 1.4
• 作者: Schuchart, Joseph;Samfass, Philipp;Niethammer, Christoph;Gracia, José;Bosilca, George
• 通讯作者: Bosilca, George