OAC Core: Small: Collaborative Research: Scalable Run-Time for Highly Parallel, Heterogeneous Systems

超级计算机已经成为许多科学领域的重要工具，包括工程和医学的进步，并有助于国家安全。许多领域的进步取决于超级计算机性能及其可用性的持续改进。过程之间的通信是这项工作的关键组成部分，也是这个项目的目标。这个项目脱离了传统的通信协议。相反，该项目侧重于提供硬件和软件之间的中间解决方案。这种方法可以潜在地减少通信开销，更好地将通信库的功能与现代通信适配器的功能相匹配，还可以改善现代并行计算框架和应用程序的需求之间的匹配。通过提高计算平台的通信能力，本项目将促进更快、更灵活的通信能力，并将缩短科学应用的完成时间。因此，它增加了现有和未来网络基础设施平台的科学吞吐量。这个项目的研究和教育成果是密切相关的，产生了训练有素的新一代研究人员和工程师，从而形成了一支更高效、更有全球竞争力的劳动力队伍。因此，本项目符合美国国家科学基金会以科学促进科学进步和国家繁荣富强的使命，符合国家利益。该项目汇集了一个多学科团队，旨在打破诸如消息传递接口等标准的限制，并为处理未来计算框架和高端系统的需求指明道路。为此，本项目(1)设计并实现了一个具有新的通信原语的通信库，以实现无串行瓶颈的快速协调，管理不规则的细粒度通信，并提供新的高效同步机制；(2)通过使用它来加速基于多个任务的运行时（Legion, PaRSEC）和通信库（MPI和GasNET），展示了该库的价值；(3)通过将关键组件移植到可编程网卡来展示硬件支持的价值；(4)对主流通信库进行改进和扩展，以提供新的功能。这项工作特别强调了新兴的编程模型，如Legion或PaRSEC，以及新兴的应用领域，如图分析。它的目标是一种正交设计，其中不同的生产者缓冲区与消费者缓冲区关联机制可以与不同的生产者和消费者同步机制组成；以及哪些机制可以专门用于提供有效的硬件支持。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Supercomputing has become an essential tool in many scientific fields, including advances in engineering and medicine, and contributes to national security. Progress in many areas depends on continued improvements in the performance of supercomputers and their usability. Communication between processes is a critical component of this effort and is the target of this project. This project departs from the traditional communication protocols. Rather, the project focuses on providing middle ground solutions between hardware and software. This approach potentially reduces communication overheads and better matches the functionality of the communication library to the capabilities of modern communication adapters and also improves the match between the requirements of modern parallel computing frameworks and applications. By improving the communication capabilities of computational platforms, this project will promote faster and more flexible communication capabilities and will improve the time to completion of scientific applications. It, therefore, increases the scientific throughput of existing and future cyberinfrastructure platforms. The research and educational outcomes of this project are closely related, resulting in highly trained new generations of researchers and engineers leading to a more efficient and globally competent workforce. Therefore, this project aligns with the NSF's mission to promote the progress of science and to advance national prosperity and welfare through science, and serves the national interest. This project brings together a multidisciplinary team and aims at breaking away from the limitation of standards such as Message Passing Interface and pointing the way for handling the needs of future computational frameworks and high-end systems. To this end the project (1) designs and implements a communication library with new communication primitives to enable fast coordination with no serial bottleneck, to manage irregular, fine grain communication, and to provide new efficient synchronization mechanisms; (2) demonstrates the value of this library by using it to accelerate multiple task-based runtimes (Legion, PaRSEC) and communication libraries (MPI and GasNET); (3) demonstrates the value of hardware support by porting key components to a programmable NIC; and (4) delivers improvements and extensions to mainstream communication libraries to provide the new functionality. This work puts a special emphasis on emerging programming models, such as Legion or PaRSEC, and on emerging application domains, such as graph analytics. It aims at an orthogonal design where different mechanisms for associating producer buffer with consumer buffer can be composed with different mechanisms for synchronizing producer and consumer; and where mechanisms can be specialized so as to allow efficient hardware support.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.