Quality of Service Guarantee for Scalable Parallel Storage Systems

可扩展并行存储系统的服务质量保证

• 批准号: 0621512
• 负责人: Tzi-Cker Chiueh
• 金额: $ 38.49万
• 依托单位: SUNY at Stony Brook
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2006
• 资助国家: 美国
• 起止时间: 2006-09-01 至 2012-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0621512&HistoricalAwards=false
• 关键词: Quality; Service; Guarantee; Scalable; Parallel

This project aims to design, implement and evaluate a scalable parallel storage system for compute clusters called Platypus, that provides bandwidth guarantee for individual applications when multiple of them run on the same cluster simultaneously, and supports a decoupled file fetching mechanism that can effectively overlap CPU processing and disk access and decrease the degree of burstiness in disk access streams. Platypus's disk QoS guarantee algorithm offers long-term/short-term performance isolation among concurrently running parallel applications, and maximizes the overall disk utilization efficiency by exploiting the slack in the QoS enforcement process. Platypus's file prefetching mechanism applies the concept of decoupled architecture, which was originally proposed to bridge the gap between CPU and memory, to achieve close to perfect disk prefetching, and can effectively mask both disk I/O and networkingdelay associated with file accesses in for parallel applications. To evaluate the effectiveness and efficiency of Platypus, the PIs propose to build a parallel file access trace player which allows researchers to evaluate parallel file systems based on pre-collected traces in a scalable way.

本项目旨在设计、实现和评估一个可扩展的并行计算集群存储系统Platypus，当多个应用程序同时在同一个集群上运行时，该系统为单个应用程序提供带宽保证，并支持解耦的文件读取机制，有效地重叠CPU处理和磁盘访问，降低磁盘访问流的突发程度。Platypus的磁盘QoS保证算法提供了长期/短期的性能隔离之间并发运行的并行应用程序，并最大限度地提高整体磁盘的利用效率，利用松弛的QoS执行过程。Platypus的文件预取机制采用了解耦架构的概念，该架构最初是为了弥合CPU和内存之间的差距而提出的，实现了接近完美的磁盘预取，并能有效地屏蔽与文件访问相关的磁盘I/O和网络延迟，以支持并行应用。为了评估Platypus的有效性和效率，PI建议构建一个并行文件访问跟踪播放器，允许研究人员以可扩展的方式基于预先收集的跟踪来评估并行文件系统。