RADICAL-Pilot: Scalable Execution of Heterogeneous and Dynamic Workloads on Supercomputers

RADICAL-Pilot: Scalable Execution of Heterogeneous and Dynamic Workloads on Supercomputers
复制标题

RADICAL-Pilot:超级计算机上异构动态工作负载的可扩展执行

DOI:
--
复制
发表时间:
2015
期刊:
arXiv.org
影响因子:
--
通讯作者:
S. Jha
S. Jha
中科院分区:
--
文献类型:
--
作者:
André Merzky;M. Santcroos;M. Turilli;S. Jha

文献摘要

参考文献

被引文献

相似文献

传统上,高性能计算(HPC)系统已被优化以支持大多数单片工作负载。然而,许多重要的科学应用的工作量,是由空间和时间异构的任务,往往是动态相互关联的。这些工作负载可以从在HPC资源上大规模执行中受益,但它们的资源利用率要求与HPC系统软件和HPC使用策略的功能之间存在紧张关系。试点系统已成功地用于解决这种紧张局势。在本文中,我们介绍了自由基试点(RP),一个可扩展的和可互操作的试点系统,忠实地实现了试点的抽象。我们描述了它的设计和表征其组件的性能,以及它的性能在多个异构HPC系统。具体来说,我们RP的任务执行组件(RP代理),这是工程的最佳资源利用率,同时保持充分的一般性试点抽象的特点。
Traditionally high-performance computing (HPC) systems have been optimized to support mostly monolithic workloads. The workload of many important scientific applications however, is comprised of spatially and temporally heterogeneous tasks that are often dynamically inter-related. These workloads can benefit from being executed at scale on HPC resources but a tension exists between their resource utilization requirements and the capabilities of HPC system software and HPC usage policies. Pilot systems have successfully been used to address this tension. In this paper we introduce RADICAL-Pilot (RP), a scalable and interoperable pilot system that faithfully implements the Pilot abstraction. We describe its design and characterize the performance of its components, as well as its performance on multiple heterogeneous HPC systems. Specifically, we characterize RP's task execution component (the RP Agent), which is engineered for optimal resource utilization while maintaining the full generality of the Pilot abstraction.
使用 XDMoD 促进 XSEDE 操作、规划和分析
DOI: 10.1145/2484762.2484763
发表时间: 2013
期刊: Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery (XSEDE '13
影响因子: --
作者:
Furlani, Thomas R.;Schneider, Barry L.;Jones, Matthew D.;Towns, John;Hart, David L.;Gallo, Steven M.;DeLeon, Robert L.;Lu, Charng-Da;Ghadersohi, Amin;Gentner, Ryan J.
通讯作者: Gentner, Ryan J.
DOI: 10.1021/ct500776j
发表时间: 2015
影响因子: 5.5
作者:
Radak,BrianK;Romanus,Melissa;Lee,Tai-Sung;Chen,Haoyuan;Huang,Ming;Treikalis,Antons;Balasubramanian,Vivekanandan;Jha,Shantenu;York,DarrinM
通讯作者: York,DarrinM