HECURA: Improving Scalability in Parallel File Systems for High End Computing

HECURA：提高高端计算并行文件系统的可扩展性

• 批准号: 0621441
• 负责人: Walter Ligon
• 金额: $ 49.98万
• 依托单位: Clemson University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2006
• 资助国家: 美国
• 起止时间: 2006-08-15 至 2010-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0621441&HistoricalAwards=false
• 关键词: HECURA; Improving; Scalability; Parallel; File

As high end computing systems (HECs) grow to several tens of thousands of nodes, file I/O is becoming a critical performance issue. Current parallel file systems such as PVFS2 and others, can reasonably stripe data across a hundred nodes and achieve good performance for bulk transfers involving large aligned accesses. Serious performance limits exist, however, for small unalignedaccesses, metadata operations, and accesses impacted by the consistency semantics (any time one process writes data that is read by another).The proposed research would study scalable metadata operations, small, unaligned data accesses, reliability through redundancy, and management of I/O resources. The employed techniques include active caching and buffering, server-to-server and client-to-client communication, and autonomics. To enhance portability and control complexity proposed research intend to employ middleware whenever possible, and use PVFS2 file system that allows a large degree of configurability. The proposed research intends to enhance that file system so that it will scale to very large sizes.

随着高端计算系统（HEC）增长到数万个节点，文件I/O正在成为一个关键的性能问题。目前的并行文件系统，如PVFS 2和其他，可以合理地在一百个节点上条带化数据，并实现涉及大型对齐访问的批量传输的良好性能。严重的性能限制存在，但是，小unalignedaccesses，元数据操作，并访问受一致性语义（任何时候一个进程写的数据，是由另一个读取）。拟议的研究将研究可扩展的元数据操作，小，unaligned数据访问，通过冗余的可靠性，和I/O资源的管理。所采用的技术包括主动缓存和缓冲，服务器到服务器和客户端到客户端的通信，以及缓存。 为了增强可移植性和控制复杂性，提出的研究打算尽可能采用中间件，并使用PVFS 2文件系统，允许很大程度的可配置性。拟议的研究旨在增强该文件系统，以便它可以扩展到非常大的大小。