FTI: High performance Fault Tolerance Interface for hybrid systems
FTI: High performance Fault Tolerance Interface for hybrid systems
复制标题
DOI：
10.1145/2063384.2063427
复制
发表时间：
2011-11
期刊：
影响因子：
--
通讯作者：
L. Bautista-Gomez;S. Tsuboi;D. Komatitsch;F. Cappello;N. Maruyama;S. Matsuoka
中科院分区：
文献类型：
--
作者：
L. Bautista-Gomez;S. Tsuboi;D. Komatitsch;F. Cappello;N. Maruyama;S. Matsuoka
部署在当前千兆级系统上的大型科学应用程序花费了大量的执行时间将检查点文件转储到远程存储。新的容错技术将是有效利用千兆级后系统的关键。在这项工作中，我们提出了一种低开销的高频多层次检查点技术，其中我们在三层检查点方案中集成了高可靠的拓扑感知Reed-Solomon编码。我们使用每个节点一个容错专用线程来有效地隐藏编码时间。我们在容错接口FTI中实现了我们的技术。我们评估了性能模型的正确性，并对库的可靠性进行了研究。为了证明FTI的性能，我们以TSUBAME2.0上的SPECFEM3D为例，对Mw9.0日本东北地震进行了模拟。我们演示了在持续的0.1 petaflops运行（1152个gpu）时，检查点开销低至8%，同时检查点的频率很高。
Large scientific applications deployed on current petascale systems expend a significant amount of their execution time dumping checkpoint files to remote storage. New fault tolerant techniques will be critical to efficiently exploit post-petascale systems. In this work, we propose a low-overhead high-frequency multi-level checkpoint technique in which we integrate a highly-reliable topology-aware Reed-Solomon encoding in a three-level checkpoint scheme. We efficiently hide the encoding time using one Fault-Tolerance dedicated thread per node. We implement our technique in the Fault Tolerance Interface FTI. We evaluate the correctness of our performance model and conduct a study of the reliability of our library. To demonstrate the performance of FTI, we present a case study of the Mw9.0 Tohoku Japan earthquake simulation with SPECFEM3D on TSUBAME2.0. We demonstrate a checkpoint overhead as low as 8% on sustained 0.1 petaflops runs (1152 GPUs) while check-pointing at high frequency.