Scheduling multicore workload on shared multipurpose clusters
Scheduling multicore workload on shared multipurpose clusters
复制标题
在共享多用途集群上调度多核工作负载
DOI：
--
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
R. Starink
中科院分区：
文献类型：
--
作者：
J. Templon;C. Acosta;J Flix Molina;A. Forti;A. P. Yzquierdo;R. Starink
随着在单个网格作业中包含对多个核的显式请求的工作负载的出现，网格站点在工作负载调度方面面临着一系列新的挑战。部署在HEP计算站点的最常见的批处理器在仅使用这些批处理器的本机功能时在多核调度方面做得很差。本文介绍了如何实现高效的多核调度的作者所代表的网站，通过实施动态大小的多核分区，通过最小的除了扭矩/Maui批处理系统已经在这些网站上使用。本文还包括在生产中使用该系统的示例结果，以及对节点大小和作业大小对性能（特别是多核作业吞吐量的提升）的依赖性的测量。
With the advent of workloads containing explicit requests for multiple cores in a single grid job, grid sites faced a new set of challenges in workload scheduling. The most common batch schedulers deployed at HEP computing sites do a poor job at multicore scheduling when using only the native capabilities of those schedulers. This paper describes how efficient multicore scheduling was achieved at the sites the authors represent, by implementing dynamically-sized multicore partitions via a minimalistic addition to the Torque/Maui batch system already in use at those sites. The paper further includes example results from use of the system in production, as well as measurements on the dependence of performance (especially the ramp-up in throughput for multicore jobs) on node size and job size.