Application level I/O caching on Blue Gene/P systems
Application level I/O caching on Blue Gene/P systems
复制标题
Blue Gene/P 系统上的应用程序级 I/O 缓存
DOI：
--
复制
发表时间：
2009
期刊：
影响因子：
--
通讯作者：
H. Wen
中科院分区：
文献类型：
--
作者：
Seetharami R. Seelam;I. Chung;John Bauer;Hao Yu;H. Wen
在本文中，我们提出了一个应用程序级别的激进的I/O缓存和预取系统，以隐藏I/O通过核心外应用程序所经历的访问延迟。如果没有应用程序级别的预取和缓存功能，I/O密集应用程序的用户就需要使用异步I/O调用或使用MPI-IO调用来重组它们的代码，以有效地使用大型系统资源。我们提出的用户可控的积极缓存和预取系统的解决方案在应用程序的用户空间中维护文件-IO缓存，分析I/O访问模式，预摘要请求，并在异步方面执行肮脏数据的写入。因此，每次应用程序需要数据时，它不必为进入存储并获取所需数据的全部I/O延迟罚款。我们已经在蓝色基因/p（BGP）系统上实施了这种积极的缓存和异步预取。初步实验使用WRF基准评估了缓存性能。 BGP系统上的结果表明，我们的方法改善了应用I/O吞吐量。
In this paper, we present an application level aggressive I/O caching and prefetching system to hide I/O access latency experienced by out-of-core applications. Without the application level prefetching and caching capability, users of I/O intensive applications need to rewrite them with asynchronous I/O calls or restructure their code with MPI-IO calls to efficiently use the large scale system resources. Our proposed solution of user controllable aggressive caching and prefetching system maintains a file-IO cache in the user space of the application, analyzes the I/O access patterns, prefetches requests, and performs write-back of dirty data to storage asynchronously. So each time the application needs the data it does not have to pay the full I/O latency penalty in going to the storage and getting the required data. We have implemented this aggressive caching and asynchronous prefetching on the Blue Gene/P (BGP) system. The preliminary experiment evaluates the caching performance using the WRF benchmark. The results on BGP system demonstrate that our method improves application I/O throughput.