Next Generation Software: Coordinated Allocation of Processor and I/O Resources in Parallel Systems

EIA-9974992 Smirni，Evgenia威廉玛丽学院&下一代软件：并行系统中处理器和I/O资源的协调分配当今困扰大多数并行系统的一个问题是资源管理效率低下。 并行系统经常被过度使用，但它们为各个应用程序提供的性能相对较低。 近年来，许多研究致力于分配并行系统的处理器到竞争应用程序的方法。 然而，一个传统上被忽视的问题是，许多应用程序也会争夺共享的输入/输出（I/O）资源。 由于I/O资源属于存储器层次结构中最慢的一级，因此它们的有效管理对于高性能至关重要，所提出的研究重点是开发一个分配框架，该框架集成了并行系统中计算和I/O资源的管理。 这项研究是便利的，首先，通过以前获得的定量数据的处理和I/O的要求，并行科学应用。 此外，本发明还最近关于处理器调度的研究明确考虑了并行科学应用的I/O需求，表明性能趋势与以前观察到的仅考虑处理器分配的趋势有很大不同。所提出的计划考虑了对处理器和I/O资源的协调分配策略的系统探索，并研究了传统处理器调度或I/O中没有解决的问题。O并行系统的研究。 该项目的主要目标是：1）开发一种分析模型，该模型有效地捕获了在磁盘上的不同数据分布下以及在不同的计算资源分配下的I/O密集型应用的可伸缩性，2）通过建模和实验测量来分析新的双重资源分配策略的相对优点和缺点，以及3）开发统一框架，该统一框架允许处理器调度器和并行文件系统朝着共享各种执行应用程序中的并行资源的共同目标联合操作，以便最大化整体系统性能。 所提出的工作将在各种并行平台上进行实验验证，并将实现双资源分配算法，以确保它们在这些平台上的可移植性。

EIA-9974992Smirni, EvgeniaCollege of William & MaryNext Generation Software: Coordinated Allocation of Processor and I/O Resources in Parallel SystemsA problem that plagues most parallel systems today is inefficient management of resources. Parallel systems are frequently over-utilized, yet they deliver relatively low performance to individual applications. In recent years, much research had been devoted to methods for allocating the processors of a parallel system to competing applications. However, an issue that has been traditionally overlooked is that many applications also contend for shared Input/Output (I/O) resources. Since I/O resources belong to the slowest level of memory hierarchy, their efficient management becomes critical for high performance.The proposed research focuses on the development of an allocation framework that integrates the management of computational and I/O resources in parallel systems. This research is facilitated, firstly, by previously obtained quantitative data on the processing and I/O requirements of parallel scientific applications. Additionally, recent studies on processor scheduling that explicitly consider the I/O demands of parallel scientific applications demonstrate performance trends that differ significantly from previously observed trends where only processor allocation is considered.The proposed plan considers a systematic exploration of coordinated allocation strategies of both processor and I/O resources and investigates issues that have not been addressed in traditional processor scheduling or I/O research in parallel systems. The primary objectives of this project are: 1) the development of an analytic model that effectively captures the scalability of I/O intensive applications under different data distributions on the disks and under different assignment of computational resources, 2) the analysis of the relative advantages and disadvantages of new dual resource allocation strategies through modeling and experimental measurements, and 3) the development of a unified framework that allows the processor scheduler and the parallel file system to operate jointly towards the common goal of sharing the parallel resources amoung the various executing applications in order to maximize overall system performance. The proposed work will be experimentally verified on a variety of parallel platforms and the dual resource allocation algorithms will be implemented so as to ensure their portability across these platforms.