Merge or Separate?: Multi-job Scheduling for OpenCL Kernels on CPU/GPU Platforms
Merge or Separate?: Multi-job Scheduling for OpenCL Kernels on CPU/GPU Platforms
复制标题
合并还是分离？：CPU/GPU 平台上 OpenCL 内核的多作业调度
DOI：
--
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
M. O’Boyle
中科院分区：
文献类型：
--
作者：
Y. Wen;M. O’Boyle
Computer systems are increasingly heterogeneous with nodes consisting of CPUs and GPU accelerators. As such systems become mainstream, they move away from specialized high-performance single application platforms to a more general setting with multiple, concurrent, application jobs. Determining how jobs should be dynamically best scheduled to heterogeneous devices is non-trivial. In certain cases, performance is maximized if jobs are allocated to a single device, in others, sharing is preferable. In this paper, we present a runtime framework which schedules multi-user OpenCL tasks to their most suitable device in a CPU/GPU system. We use a machine learning-based predictive model at runtime to detect whether to merge OpenCL kernels or schedule them separately to the most appropriate devices without the need for ahead-of-time profiling. We evaluate out approach over a wide range of workloads, on two separate platforms. We consistently show significant performance and turn-around time improvement over the state-of-the-art across programs, workload, and platforms.
