An Application-Level Incremental Checkpointing Mechanism with Automatic Parameter Tuning
An Application-Level Incremental Checkpointing Mechanism with Automatic Parameter Tuning
复制标题
DOI：
10.1109/candar.2017.96
复制
发表时间：
2017-11
期刊：
影响因子：
--
通讯作者：
Hiroyuki Takizawa;Muhammad Alfian Amrizal;Kazuhiko Komatsu;Ryusuke Egawa
中科院分区：
文献类型：
--
作者：
Hiroyuki Takizawa;Muhammad Alfian Amrizal;Kazuhiko Komatsu;Ryusuke Egawa
尽管增量检查点是减少检查点开销的有效方法，但它主要针对系统级检查点进行讨论。由于正在运行的应用程序的整个内存空间都保存在检查点文件中，因此系统级检查点对于下一代超大规模计算系统来说不太实用，其中 I/O 操作比计算昂贵得多，特别是在功耗方面。因此，在这项工作中，增量检查点的思想被应用于应用程序级检查点，其中程序员明确指定要保存到检查点文件中的模拟数据，以便仅保存恢复模拟所需的数据。这项工作假设，在增量检查点中，仅当管理区域中的任何页面自上次检查点以来已更新时，才会将由多个内存页面组成的管理区域写入检查点文件。管理粒度定义为管理区域中的页数。如果管理区域仅由更新的页面组成，那么大的粒度可能会减少检查点开销。然而，如果粒度太大，管理区域将包含许多自上次检查点以来未更新的页面，因此增量检查点不能减少要写入检查点文件的页面数量。因此，本文提出了一种具有粒度自动调整的应用程序级增量检查点机制，以减少遗留模拟代码的检查点开销。
Although incremental checkpointing is an effective way of reducing the checkpointing overhead, it has been discussed mostly for system-level checkpointing. Since the whole memory space of a running application is saved in a checkpoint file, system-level checkpointing will be less practical for future-generation extreme-scale computing systems, in which the I/O operation is much more expensive than the computation, especially in terms of power consumption. In this work, hence, the idea of incremental checkpointing is applied to application-level checkpointing, in which programmers explicitly specify the simulation data to be saved into a checkpoint file so that only necessary data for resuming the simulation are saved. This work assumes that, in incremental checkpointing, a management region consisting of multiple memory pages is written to a checkpoint file only if any page in the management region has been updated since the last checkpointing. A management granularity is defined as the number of pages in a management region. A large granularity is likely to reduce the checkpointing overhead if a management region consists of only updated pages. However, if the granularity is too large, a management region will contain a lot of pages not updated since the last checkpointing, and thus incremental checkpointing cannot reduce the number of pages to be written into a checkpoint file. Therefore, this paper proposes an application-level incremental checkpointing mechanism with granularity autotuning for reducing the checkpointing overhead of a legacy simulation code.