EAGER: Prototype I/O Convolver

我们将开发一个原型I/O卷积器，这是一个框架相结合的I/O配置文件，是表征的速度，一台机器？的I/O和关联的文件系统可以执行I/O操作，I/O签名是HPC应用程序的记录？的文件访问模式，以产生I/O性能模型，可以解释，预测，并用于提高HPC应用程序的I/O性能。影响真实的系统上的应用程序性能的外部因素的数量需要额外的表征和模型开发来预测真实的世界环境。因此，尽管在开发真正通用的I/O性能模型方面存在许多技术困难，但在EAGER的范围内似乎可以实现更有限版本的有用I/O模型。这项工作预计将产生两个有益的成果：1）两个HPC应用程序的预测I/O模型，这两个HPC应用程序在两个体系结构上为特定文件系统执行重要但简单的I/O，可用于解释和提高这些应用程序在给定文件系统上的性能2）实验性基础架构，可用于追求开发通用I/O的更大研究议程可跨多个文件系统和系统规模进行扩展的O模型。该项目将刺激新的工具和方法的开发，以处理大规模的海量文件系统，它们的管理，理解和测量。拟议的建模研究和I/O改进将利用在TeraGrid和国防部高性能计算现代化计划下开发的HPC环境。I/O性能模型的创建必然会使人们更好地理解重要的文件系统功能以及它们如何影响应用程序。

We will develop a prototype I/O convolver that is a framework for combining I/O profiles that are characterizations of the rates at which a machine?s I/O and associated file systems can perform I/O operations, with I/O signatures that are records of HPC application?s file access patterns, to produce I/O performance models which can explain, predict, and be used to improve I/O performance of HPC applications. The number of external factors that impact applications performance on real systems requires additional characterization and model development to predict real world environments. Therefore despite many technical difficulties in developing truly general I/O performance models, more limited versions of useful I/O models seem achievable within the scope of an EAGER. This work is expected to have two useful outcomes: 1) predictive I/O models of two HPC applications that do significant but simple I/O for a particular file system on two architectures that can be used to explain and improve performance of these applications on the given file system 2) an experimental infrastructure that could be used to pursue the larger research agenda of developing general I/O models that scale across multiple file systems and system scales. This project will stimulate development of new tools and approaches to deal with large scale massive file systems, their management, understanding, and measurement. The proposed modeling investigations and I/O improvements will leverage the HPC environments developed under both TeraGrid and the DoD High Performance Computing Modernization Program. The creation of I/O performance models will necessarily lead to a greater understanding of the important file system features and how they affect applications.