SHF: Small: Advanced Compiler Techniques for Meeting Fault Tolerance Needs of HPC Systems

SHF：小型：满足 HPC 系统容错需求的先进编译器技术

• 批准号: 1319420
• 负责人: Gagan Agrawal
• 金额: $ 49.97万
• 依托单位: Ohio State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-07-01 至 2017-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1319420&HistoricalAwards=false
• 关键词: SHF; Small; Advanced; Compiler; Techniques

Making high performance applications resilient to failure of individual nodes is a major challenge today. Particularly, there is a need for reducing the overheads associated with checkpointing and for dealing with silent data corruption in an effective fashion. This project at Ohio State University is addressing these problems based on new insights and approaches. The work on improving the efficiency of checkpointing and restart is based on the following observation - current checkpointing protocols were developed in context of distributed computing, and do not exploit key properties seen in most scientific parallel programs. This project is developing static and dynamic analysis methods to determine what we refer to as the "message intent", which can then be used to allow automated application-level uncoordinated checkpointing, but without the need for message logging, keeping the checkpoint sizes small, and recovery low-cost. In addition, a distinct software approach for handling silent data corruption is being developed. The idea is to make the data structures that control what computation and/or communication occurs in the program resilient, by only replicating them and their storage. This introduces modest overheads, but guards against the most drastic impact of silent data corruption on program stability and correctness. This research will result in reducing overheads of making high performance systems resilient, which in turn will improve the efficiency and resource utilization.

使高性能应用程序能够抵御单个节点的故障是当今的一个主要挑战。 特别地，需要减少与检查点相关联的开销，并且需要以有效的方式处理无声数据损坏。 俄亥俄州州立大学的这个项目正在基于新的见解和方法来解决这些问题。 提高检查点和重启效率的工作基于以下观察-当前的检查点协议是在分布式计算的背景下开发的，并且不利用大多数科学并行程序中的关键属性。 该项目正在开发静态和动态分析方法，以确定我们所说的“消息意图”，然后可以使用该方法来允许自动化应用程序级非协调检查点，但不需要消息日志记录，保持检查点大小 小，回收成本低。 此外，正在开发一种用于处理静默数据损坏的独特软件方法。 这个想法是使控制程序中发生的计算和/或通信的数据结构具有弹性，只需复制它们及其存储。 这引入了适度的开销，但可以防止静默数据损坏对程序稳定性和正确性的最严重影响。这项研究将减少使高性能系统具有弹性的管理费用，从而提高效率和资源利用率。