A High Throughput Massive I/O Storage Hierarchy for PETA-scale High-end Architectures

适用于 PETA 规模高端架构的高吞吐量海量 I/O 存储层次结构

• 批准号: 0702244
• 负责人: Guang Gao
• 金额: --
• 依托单位: University of Delaware
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-05-01 至 2010-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0702244&HistoricalAwards=false
• 关键词: Throughput; Massive; Storage; Hierarchy; PETA

Modern high-end computer (HEC) architectures (comprised of tens-of-thousands of processors or more) have widened the performance gap between the computing power and the storage and I/O performance that can support and sustain such calculations. With the petascale computing (1015 floating point operations per second) just over the horizon, the gap will be even more pronounced. This research is aimed at addressing both the limited bandwidth and the performance of today's I/O storage systems. The main idea is to replace traditional rotary disks with a 'memory pool' - a massive grid of solid-state (flash) memories, and to introduce a new memory hierarchy model based on the improved access time and bandwidth of such grid. A memory pool embedded and distributed across the compute engine leverages the rapid progression of solid-state storage technology.The I/O-aware multithreaded program execution model takes full advantage of the tremendous bandwidth to the local memory pool, while tolerating the solid state storage access latency through proactive distributed pre-fetching and software-controlled memory caching. In particular, the responses to different patterns of solid-state storage communication requests (blocking and non-blocking, and of various block sizes), simulated solid-state storage module failures, extended shared memory responsiveness and management are examined. The effectiveness of the approach is observed through the most common set of third party I/O benchmarks.The intellectual merit of this research can be summarized as:1) Development of a novel I/O architecture model. for a class of high-end petascale computing systems. 2) Development of a corresponding RAS model3) An experimental study on the new I/O architecture and software model (in (1) and (2) above).

现代高端计算机（HEC）架构（由数万个或更多处理器组成）已经扩大了计算能力与存储和I/O性能之间的性能差距，这些性能可以支持和维持这种计算。随着千万亿次计算（每秒1015次浮点运算）即将到来，差距将更加明显。本研究旨在解决当今I/O存储系统的有限带宽和性能问题。其主要思想是取代传统的旋转磁盘与“内存池”-一个大规模的网格的固态（闪存）存储器，并引入一个新的内存层次模型的基础上改进的访问时间和带宽这样的网格。在计算引擎中嵌入和分布的内存池充分利用了固态存储技术的快速发展。I/O感知的多线程程序执行模型充分利用了本地内存池的巨大带宽，同时通过主动分布式预取和软件控制的内存缓存来容忍固态存储访问延迟。特别是，不同模式的固态存储通信请求（阻塞和非阻塞，以及各种块大小），模拟固态存储模块故障，扩展的共享内存响应和管理的响应进行检查。通过一组最常见的第三方I/O基准测试，验证了该方法的有效性。本研究的学术价值可以概括为：1）开发了一种新的I/O体系结构模型。一种高端千万亿次计算系统的设计2)3）对新的I/O体系结构和软件模型进行了实验研究。