Next Generation Software: Coordinated Allocation of Processor and I/O Resources in Parallel Systems

EIA-9974992斯米尔尼，叶夫根尼威廉与玛丽学院下一代软件：并行系统中处理器和I/O资源的协调分配目前困扰大多数并行系统的一个问题是资源管理效率低下。并行系统经常被过度利用，但它们为单个应用程序提供的性能相对较低。近年来，许多研究致力于将并行系统的处理器分配给竞争应用的方法。然而，一个传统上被忽视的问题是，许多应用程序也会争夺共享的输入/输出(I/O)资源。由于I/O资源属于内存层次结构中速度最慢的一级，因此对其进行有效的管理成为提高性能的关键。首先，通过先前获得的关于并行科学应用的处理和I/O需求的定量数据，促进了这项研究。此外，最近关于处理器调度的研究明确考虑了并行科学应用的I/O需求，其性能趋势与以前只考虑处理器分配的趋势显著不同。提出的计划考虑了系统地探索处理器和I/O资源的协调分配策略，并研究了传统处理器调度或并行系统中I/O研究中没有解决的问题。该项目的主要目标是：1)开发一个分析模型，有效地捕捉I/O密集型应用程序在不同磁盘数据分布和不同计算资源分配下的可扩展性；2)通过建模和实验测量分析新的双重资源分配策略的相对优势和劣势；3)开发一个统一的框架，允许处理器调度器和并行文件系统朝着共享不同执行应用程序之间的并行资源的共同目标共同操作，以最大化系统的整体性能。提出的工作将在各种并行平台上进行实验验证，并将实现双资源分配算法，以确保其在这些平台上的可移植性。

EIA-9974992Smirni, EvgeniaCollege of William & MaryNext Generation Software: Coordinated Allocation of Processor and I/O Resources in Parallel SystemsA problem that plagues most parallel systems today is inefficient management of resources. Parallel systems are frequently over-utilized, yet they deliver relatively low performance to individual applications. In recent years, much research had been devoted to methods for allocating the processors of a parallel system to competing applications. However, an issue that has been traditionally overlooked is that many applications also contend for shared Input/Output (I/O) resources. Since I/O resources belong to the slowest level of memory hierarchy, their efficient management becomes critical for high performance.The proposed research focuses on the development of an allocation framework that integrates the management of computational and I/O resources in parallel systems. This research is facilitated, firstly, by previously obtained quantitative data on the processing and I/O requirements of parallel scientific applications. Additionally, recent studies on processor scheduling that explicitly consider the I/O demands of parallel scientific applications demonstrate performance trends that differ significantly from previously observed trends where only processor allocation is considered.The proposed plan considers a systematic exploration of coordinated allocation strategies of both processor and I/O resources and investigates issues that have not been addressed in traditional processor scheduling or I/O research in parallel systems. The primary objectives of this project are: 1) the development of an analytic model that effectively captures the scalability of I/O intensive applications under different data distributions on the disks and under different assignment of computational resources, 2) the analysis of the relative advantages and disadvantages of new dual resource allocation strategies through modeling and experimental measurements, and 3) the development of a unified framework that allows the processor scheduler and the parallel file system to operate jointly towards the common goal of sharing the parallel resources amoung the various executing applications in order to maximize overall system performance. The proposed work will be experimentally verified on a variety of parallel platforms and the dual resource allocation algorithms will be implemented so as to ensure their portability across these platforms.