A user-transparent recoverable file system for distributed computing environment

A user-transparent recoverable file system for distributed computing environment
复制标题

DOI:
10.1109/clade.2005.1520898
复制
发表时间:
2005-07
期刊:
CLADE 2005. Proceedings Challenges of Large Applications in Distributed Environments, 2005.
影响因子:
--
通讯作者:
H. Kim;H. Yeom
H. Kim;H. Yeom
中科院分区:
其他
文献类型:
--
作者:
H. Kim;H. Yeom

文献摘要

被引文献

相似文献

In a distributed computing environment, particularly grid, fault-tolerance is one of the core functionalities the system should provide. MPICH-GF is such a resilient system designed to resist external or internal failures, especially for message passing applications in the grid environment. But it does not stand the loss of a valuable resource: files. In a normal case, users open files and write data into them in an asynchronous manner, and checkpointing is initiated with no regard to the state of the context of the process. Therefore, the checkpointing system should automatically recognize the running process and protect the open files transparently. We have implemented a recoverable file system, named ReFS, which is incorporated into our fault-tolerant system MPICH-GF. ReFS is a versioning-like file system. ReFS provides middleware libraries with the system call interface to protect specific files at a given time. This prevents applications from processing their jobs with corrupted data and resulting in incorrect results in case of failures. We have focused not only on the reliability of the system but also on the reduction of inevitable overheads. This paper describes the design and implementation of ReFS and justifies the validity of the behavior of ReFS. We have developed ReFS on Linux, based on Ext2.