Fault tolerance of MPI applications in exascale systems: The ULFM solution
Fault tolerance of MPI applications in exascale systems: The ULFM solution
复制标题
DOI：
10.1016/j.future.2020.01.026
复制
发表时间：
2020-05
期刊：
影响因子：
--
通讯作者：
Nuria Losada;P. González;María J. Martín;G. Bosilca;A. Bouteiller;K. Teranishi
中科院分区：
文献类型：
--
作者：
Nuria Losada;P. González;María J. Martín;G. Bosilca;A. Bouteiller;K. Teranishi
高性能计算（HPC）系统使用的计算资源数量的增长导致故障率的增加。容错技术将成为必不可少的长期运行的应用程序在未来的exascale系统中执行，不仅要确保他们在这些系统中的执行完成，而且要改善他们的能源消耗。虽然消息传递接口（MPI）是分布式内存HPC系统最流行的编程模型，但到目前为止，它没有为用户提供任何容错结构来处理故障。因此，恢复过程被推迟，直到应用程序被中止并重新产生。MPI论坛中的用户级故障缓解（ULFM）接口的提议为这一领域提供了新的机会，使弹性MPI应用程序，系统运行时和编程语言结构的实现能够检测和响应故障而不中止其执行。本文介绍了ULFM规范提供的弹性接口的全球概述，涵盖了原型使用模式和构建块，并调查了近年来利用它们的各种应用程序驱动的解决方案。文献中大量不同的方法证明，ULFM提供了必要的灵活性，实现高效的容错MPI应用程序。所有提出的解决方案都基于应用程序驱动的恢复机制，这可以减少开销，并获得所需的效率水平，在未来的exascale平台。
The growth in the number of computational resources used by high-performance computing (HPC) systems leads to an increase in failure rates. Fault-tolerant techniques will become essential for long-running applications executing in future exascale systems, not only to ensure the completion of their execution in these systems but also to improve their energy consumption. Although the Message Passing Interface (MPI) is the most popular programming model for distributed-memory HPC systems, as of now, it does not provide any fault-tolerant construct for users to handle failures. Thus, the recovery procedure is postponed until the application is aborted and re-spawned. The proposal of the User Level Failure Mitigation (ULFM) interface in the MPI forum provides new opportunities in this field, enabling the implementation of resilient MPI applications, system runtimes, and programming language constructs able to detect and react to failures without aborting their execution. This paper presents a global overview of the resilience interfaces provided by the ULFM specification, covers archetypal usage patterns and building blocks, and surveys the wide variety of application-driven solutions that have exploited them in recent years. The large and varied number of approaches in the literature proves that ULFM provides the necessary flexibility to implement efficient fault-tolerant MPI applications. All the proposed solutions are based on application-driven recovery mechanisms, which allows reducing the overhead and obtaining the required level of efficiency needed in the future exascale platforms.