The RAMDISK storage accelerator: a method of accelerating I/O performance on HPC systems using RAMDISKs
The RAMDISK storage accelerator: a method of accelerating I/O performance on HPC systems using RAMDISKs
复制标题
RAMDISK 存储加速器：一种使用 RAMDISK 加速 HPC 系统 I/O 性能的方法
DOI：
10.1145/2318916.2318922
复制
发表时间：
2012
影响因子：
5.2
通讯作者：
C. Carothers
中科院分区：
文献类型：
--
作者：
Tim Wickberg;C. Carothers
大规模 HPC 系统中的 I/O 性能未能跟上计算性能的提高。这种不断扩大的差距提供了一个机会，可以在 HPC 环境中引入专门针对这一差距的新层。提出了RAMDISK存储加速器（RSA）；一种利用 DRAM 的高吞吐量和降低成本的系统，提供应用程序透明的方法来预暂存输入数据并将结果提交回持久磁盘存储系统。
RSA 由一组单独的 RSA 节点构成；每个都具有大量 DRAM 和与存储网络的高速连接。每个节点的内存都可以通过动态构建的并行文件系统提供给计算作业；数据在计算作业开始之前异步暂存在 RAMDISK 上，并在作业完成后写回到永久磁盘系统。 RAMDISK 提供专用于特定作业的超高速、低延迟临时存储。异步数据暂存使计算系统免于在执行开始和结束时等待文件 I/O 完成的时间。 RSA Scheduler 的构建是为了演示这种异步数据暂存模型。
I/O performance in large-scale HPC systems has not kept pace with improvements in computational performance. This widening gap presents an opportunity to introduce a new layer into the HPC environment that specifically targets this divide. A RAMDISK Storage Accelerator (RSA) is proposed; a system leveraging the high-throughput and decreasing cost of DRAM to provide an application-transparent method for pre-staging input data and commit results back to a persistent disk storage system.
The RSA is constructed from a set of individual RSA nodes; each with large amounts of DRAM and a high-speed connection to the storage network. Memory from each node is made available through a dynamically constructed parallel filesystem to a compute job; data is asynchronously staged on to the RAMDISK ahead of compute job start and written back out to the persistent disk system after job completion. The RAMDISK provides very-high-speed, low-latency temporary storage that is dedicated to a specific job. Asynchronous data-staging frees the compute system from time that would otherwise be spent waiting for file I/O to finish at the start and end of execution. The RSA Scheduler is constructed to demonstrate this asynchronous data-staging model.