Evolution of CMS workload management towards multicore job support
Evolution of CMS workload management towards multicore job support
复制标题
CMS 工作负载管理向多核作业支持的演变
DOI：
10.1088/1742-6596/664/6/062046
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
E. Vaandering
中科院分区：
文献类型：
--
作者：
A. P. Yzquierdo;J. Hernández;F. A. Khan;J. Letts;K. Majewski;A M Rodrigues;A. McCrea;E. Vaandering
多核处理器体系结构的成功利用是大型强子对撞机运行2即将到来的时代大型强子对撞机分布式计算系统的一个关键因素。高堆积复杂碰撞事件对传统的顺序编程在内存和处理时间预算方面构成了挑战。CMS数据生产和处理框架正在引入重建和模拟算法的并行执行，以克服这些限制。CMS计划执行多核作业，同时仍支持其他难以并行化的任务的单核处理，如用户分析。因此，CMS的作业管理策略旨在整合网格中的单核和多核作业调度。这是通过使用具有所分配资源的内部动态分区的多核引导来实现的，能够同时运行各种核心计数的有效负载。开展了一项广泛的测试方案，以便能够利用CMS站点提供的各种本地批处理系统进行多核调度，重点是在2015年期间负责快速数据重建的第0层和第1层。已经进行了规模测试，以分析该调度策略的性能，并确保有效地使用分布式资源。本文介绍了CMS作业管理和资源供应系统的演变，以支持这种混合调度模型，以及它的部署和性能测试，这将使CMS在第二次LHC运行时过渡到多核生产模型。
The successful exploitation of multicore processor architectures is a key element of the LHC distributed computing system in the coming era of the LHC Run 2. High-pileup complex-collision events represent a challenge for the traditional sequential programming in terms of memory and processing time budget. The CMS data production and processing framework is introducing the parallel execution of the reconstruction and simulation algorithms to overcome these limitations. CMS plans to execute multicore jobs while still supporting singlecore processing for other tasks difficult to parallelize, such as user analysis. The CMS strategy for job management thus aims at integrating single and multicore job scheduling across the Grid. This is accomplished by employing multicore pilots with internal dynamic partitioning of the allocated resources, capable of running payloads of various core counts simultaneously. An extensive test programme has been conducted to enable multicore scheduling with the various local batch systems available at CMS sites, with the focus on the Tier-0 and Tier-1s, responsible during 2015 of the prompt data reconstruction. Scale tests have been run to analyse the performance of this scheduling strategy and ensure an efficient use of the distributed resources. This paper presents the evolution of the CMS job management and resource provisioning systems in order to support this hybrid scheduling model, as well as its deployment and performance tests, which will enable CMS to transition to a multicore production model for the second LHC run.
DOI：
10.1088/1742-6596/664/6/062031
发表时间：
2015-12
期刊：
Journal of Physics: Conference Series
影响因子：
--
作者：
J. Balcas;S. Belforte;B. Bockelman;D. Colling;O. Gutsche;D. Hufnagel;F. Khan;K. Larson;J. Letts;M. Mascheroni;D. Mason;A. McCrea;S. Piperov;M. Saiz-Santos;I. Sfiligoi;A. Tanasijczuk;C. Wissing
通讯作者：
J. Balcas;S. Belforte;B. Bockelman;D. Colling;O. Gutsche;D. Hufnagel;F. Khan;K. Larson;J. Letts;M. Mascheroni;D. Mason;A. McCrea;S. Piperov;M. Saiz-Santos;I. Sfiligoi;A. Tanasijczuk;C. Wissing
全球 LHC 计算网格中的多核作业调度
DOI：
10.1088/1742-6596/664/6/062016
发表时间：
2015
期刊：
Conference Series
影响因子：
--
作者：
Forti A
通讯作者：
Forti A