Resilient MPI applications using an application-level checkpointing framework and ULFM

Resilient MPI applications using an application-level checkpointing framework and ULFM
复制标题

使用应用程序级检查点框架和 ULFM 的弹性 MPI 应用程序

DOI:
--
复制
发表时间:
2016
影响因子:
3.3
通讯作者:
P. González
P. González
中科院分区:
计算机科学4区
文献类型:
--
作者:
Nuria Losada;Iván Cores;María J. Martín;P. González

文献摘要

被引文献

相似文献

未来由数百万个核心组成的亿亿级系统将呈现高故障率,长时间运行的应用程序将需要使用新的容错技术来确保成功执行。MPI论坛中的容错工作组提出了用户级故障缓解(ULFM)提案,为弹性MPI应用程序的实现提供了新的功能。在这项工作中,CPPC检查点框架扩展到利用新的ULFM功能。所提出的解决方案透明地获得弹性MPI应用程序的仪器原始应用程序代码。此外,多线程多级检查点,其中的检查点文件被保存在不同的内存级别,提高了解决方案的可扩展性。实验评估表明,在一个或多个MPI进程中容忍故障时,开销很低。
Future exascale systems, formed by millions of cores, will present high failure rates, and long-running applications will need to make use of new fault tolerance techniques to ensure successful execution completion. The Fault Tolerance Working Group, within the MPI forum, has presented the User Level Failure Mitigation (ULFM) proposal, providing new functionalities for the implementation of resilient MPI applications. In this work, the CPPC checkpointing framework is extended to exploit the new ULFM functionalities. The proposed solution transparently obtains resilient MPI applications by instrumenting the original application code. Besides, a multithreaded multilevel checkpointing, in which the checkpoint files are saved in different memory levels, improves the scalability of the solution. The experimental evaluation shows a low overhead when tolerating failures in one or several MPI processes.