EAGER: Prototype I/O Convolver

我们将开发一个原型I/O卷积器，它是一个框架，用于组合I/O配置文件，这些配置文件是机器运行速率的表征。s I/O和相关的文件系统可以执行I/O操作，I/O签名是HPC应用程序的记录。生成I/O性能模型，该模型可以解释、预测并用于改进HPC应用程序的I/O性能。在真实系统上影响应用程序性能的外部因素的数量需要额外的特征和模型开发来预测真实世界的环境。因此，尽管在开发真正通用的I/O性能模型方面存在许多技术困难，但在EAGER范围内似乎可以实现更有限版本的有用I/O模型。这项工作预计会有两个有用的结果：1)两个高性能计算应用程序的预测I/O模型，它们在两个架构上为特定文件系统做重要但简单的I/O，可用于解释和提高这些应用程序在给定文件系统上的性能2)一个实验基础设施，可用于追求开发跨多个文件系统和系统规模的通用I/O模型的更大研究议程。这个项目将刺激开发新的工具和方法来处理大规模的海量文件系统，以及它们的管理、理解和度量。拟议的建模调查和I/O改进将利用在TeraGrid和国防部高性能计算现代化计划下开发的高性能计算环境。创建I/O性能模型必然会使我们更好地理解重要的文件系统特性以及它们如何影响应用程序。

We will develop a prototype I/O convolver that is a framework for combining I/O profiles that are characterizations of the rates at which a machine?s I/O and associated file systems can perform I/O operations, with I/O signatures that are records of HPC application?s file access patterns, to produce I/O performance models which can explain, predict, and be used to improve I/O performance of HPC applications. The number of external factors that impact applications performance on real systems requires additional characterization and model development to predict real world environments. Therefore despite many technical difficulties in developing truly general I/O performance models, more limited versions of useful I/O models seem achievable within the scope of an EAGER. This work is expected to have two useful outcomes: 1) predictive I/O models of two HPC applications that do significant but simple I/O for a particular file system on two architectures that can be used to explain and improve performance of these applications on the given file system 2) an experimental infrastructure that could be used to pursue the larger research agenda of developing general I/O models that scale across multiple file systems and system scales. This project will stimulate development of new tools and approaches to deal with large scale massive file systems, their management, understanding, and measurement. The proposed modeling investigations and I/O improvements will leverage the HPC environments developed under both TeraGrid and the DoD High Performance Computing Modernization Program. The creation of I/O performance models will necessarily lead to a greater understanding of the important file system features and how they affect applications.