SHF: Medium: Collaborative Research: Next-Generation Message Passing for Parallel Programming: Resiliency, Time-to-Solution, Performance-Portability, Scalability, and QoS

基于MPI的并行编程越来越多地应用于学术界、政府（国防和非国防用途），以及可扩展机器学习和大数据分析的新兴用途。新兴的超级计算机系统将有更多的故障，MPI需要能够解决这些故障，以适应这些新出现的情况，而不是导致整个应用程序失败。高性能计算（HPC）的协作性、变革性消息传递研究对于在新的和即将到来的可扩展系统（采用“最佳实践优先，标准化后”的策略）中实现性能可移植并行编程至关重要。消息传递接口（MPI-3/4）应用程序编程接口的一个重要子集正在通过扩展实现容错，这些扩展带有在并行任务之间同步的弱集体事务。本研究研究的新模型能够定位故障，提供可调的无故障开销，允许多种故障，实现分层恢复，并具有数据并行相关性。对底层网络的故障建模进行了研究。应用程序开发人员在此工作中控制粒度和无故障开销。中间件原型的性能和可伸缩性结果主要通过与实际和学术兴趣的实际用例相关的紧凑应用程序来演示。这项工作的影响范围从政府实验室中最大的超级计算机的用户到具有长时间运行，时间关键应用程序的实际集群，以及在“敌对”环境中基于空间和其他并行处理的用户，这些环境中的故障比过去几年更频繁地发生。该项目正在生产可用的自由软件，这些软件将在社区中广泛共享，并指导如何在学术界、工业界和政府中编写更好的并行程序。该项目还提供了如何更新现有的或遗留的程序以使用正在减少到实践中的新功能的指导方针。

Parallel programming based on MPI is being used with increased frequency in academia, government (defense and non-defense uses), as well as emerging uses in scalable machine learning and big data analytics. Emerging supercomputer systems will have more faults and MPI needs to be able to workaround such faults to be appropriate to these emerging situations, rather than causing an entire application to fail. Collaborative, transformative message passing research for High Performance Computing (HPC) critical to performance-portable parallel programming in new and forthcoming scalable systems (with a strategy of "best practice-first, standardization-later") is being reduced to practice. A substantial subset of the Message Passing Interface (MPI-3/4) application programmer interface is being made fault tolerant through extensions with weak collective transactions that synchronize between parallel tasks. This research studies the novel model that localizes faults, provides tunable fault-free overhead, allows for multiple kinds of faults, enables hierarchical recovery, and is data-parallel relevant. Fault modeling of underlying networks is being studied. Application developers control the granularity and fault-free overhead in this effort. Performance and scalability results of the middleware prototype are being demonstrated principally through compact applications that relate to real use cases of practical and academic interest. The impact of this work ranges from users of the largest supercomputers in government labs to practical clusters that have long-running, time-critical applications, and to space-based and other parallel processing in "hostile" environments where faults occur more frequently than in past years. The project is producing usable free software that will be widely shared in the community as well as guidance on how better parallel programs can be written in academia, industry, and government. The project also provides guidelines for how to update existing or legacy programs to use the new capabilities that are being reduced to practice.