Collaborative Research: ITR/NGS: Deja Vu: Transparent Checkpointing and Migration of Parallel Codes Over Grid Infrastructures

一个令人生畏的挑战是从今天的计算网格发展到一个真正的网络基础设施，无缝集成资源，从学术实验室的小型集群到最大的国家超级计算中心，并提供无处不在的访问高性能计算，研究仪器，数据仓库和可视化。 实现这一未来需要透明的故障恢复机制的根本进步，以掩盖任何大规模计算资源特有的组件故障。虽然前几代超级计算机将可靠性设计到系统硬件中，但今天的高性能计算（HPC）环境基于COTS组件集群，没有针对资源整体可靠性的系统解决方案。 在不断增长的集群系统网络集合中实现稳定性需要一种软件解决方案，该解决方案通过透明、高效和自动检查点和恢复（CPR）机制提供对计算资源的可靠访问。 该项目旨在通过建立一个名为Deja Vu的综合系统，以全新的方法解决CPR和流程迁移中的长期问题，从而实现这一未来。 Deja Vu提供（a）透明的并行检查点和恢复机制，可以从任何系统故障组合中恢复，而无需对并行应用程序进行任何修改。(b)透明地捕获应用状态的新颖的编译器后分析系统，（c）在单个框架中无缝地集成用户发起的和系统发起的检查点的系统架构，使得能够有效地使用各种领域特定知识，（d）用于透明增量检查点的新颖的运行时机制，以有效地捕获维持全局一致性所需的最少量的状态，（e）一种新颖的通信体系结构，其使得能够透明地迁移现有MPI/PVM代码而无需对应用程序或MPI/PVM库进行源代码修改，（f）可恢复的IO子系统，可针对特定的存储环境进行调整，以及（g）Globus Toolkit的接口和扩充，以有效使用本研究提供的CPR和迁移能力。Deja Vu的核心CPR和迁移设施将被管理、安全和调度设施所包围，这些设施（a）与当地调度系统集成（例如，OpenPBS）和记账系统，用于特定于站点的记账和损失的计算周期的退款，以及（B）利用细粒度权限和动态创建的用户账户来扩展Globus安全架构，其允许完全利用在Deja Vu系统下可用的流体资源控制。 该项目的设计目标不仅仅是实现“点”解决方案，而是一个集成系统，将构成大规模计算设施和网格基础设施的基本组成部分。我们的研究团队（VT、PSC、ISR）在设计、开发、部署和支持完整解决方案方面拥有丰富的经验。

A daunting challenge is the evolution from today's computational Grid to a true cyberinfrastructure that seamlessly integrates resources ranging from small clusters in academic laboratories to the largest national supercomputing centers and provides ubiquitous access to high performance computing, research instrumentation, data warehouses and visualization. Realization of this future requires fundamental advances in transparent fault recovery mechanisms to mask component failures endemic to any large-scale computational resource. While previous generations of supercomputers engineered reliability into systems hardware, today's high performance computing (HPC) environments are based on clusters of COTS components, with no systemic solution for the reliability of the resource as a whole. Engendering stability in ever growing networked collections of cluster systems needs a software solution that provides reliable access to computing resources through transparent, efficient, and automatic checkpointing and recovery (CPR) mechanisms. This project aims to bring about this future through radically new approaches to longstanding problems in CPR and process migration by building an integrated system called Deja vu. Deja vu provides (a) a transparent parallel checkpointing and recovery mechanism that recovers from any combination of systems failures without any modification to parallel applications. (b) a novel post-compiler analysis system that transparently captures application state, (c) a systems architecture that seamlessly integrates user-initiated and system-initiated checkpoints in a single framework enabling the effective use of a wide variety of domain specific knowledge, (d) novel runtime mechanisms for transparent incremental checkpointing, to efficiently capture the least amount of state required to maintain global consistency, (e) a novel communications architecture that enables transparent migration of existing MPI/PVM codes without source-code modifications to either the application or the MPI/PVM libraries, (f) recoverable IO subsystems that can be tailored to specific storage environments, and (g) interfaces to and augmentation of the Globus Toolkit to effectively use the CPR and migration capabilities provided by this research. The core CPR and migration facilities of Deja vu will be surrounded by management, security, and scheduling facilities that (a) integrate with local scheduling systems (e.g., OpenPBS) and accounting systems for site-specific accounting and refunding of lost compute cycles and (b) extend the Globus security architecture with fine grain rights and dynamically created user accounts that allow the fluid resource control available under the Deja vu system to be fully exploited. The design goal of this project is not just to implement "point" solutions, but an integrated system that will constitute a fundamental component of both large-scale computing facilities and Grid infrastructures. Our research team (VT, PSC, ISR) has considerable experience in the design, development, deployment and support of complete solutions.