Achieving Performance Isolation with Lightweight Co-Kernels

Achieving Performance Isolation with Lightweight Co-Kernels
复制标题

DOI:
10.1145/2749246.2749273
复制
发表时间:
2015-06
期刊:
Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing
影响因子:
--
通讯作者:
Jiannan Ouyang;Brian Kocoloski;J. Lange;K. Pedretti
Jiannan Ouyang;Brian Kocoloski;J. Lange;K. Pedretti
中科院分区:
其他
文献类型:
--
作者:
Jiannan Ouyang;Brian Kocoloski;J. Lange;K. Pedretti

文献摘要

被引文献

相似文献

性能隔离正在成为高性能计算 (HPC) 应用程序的一项要求,特别是当 HPC 架构转向现场数据处理和应用程序组合技术以提高系统吞吐量时。这些方法需要将不同的工作负载放在同一计算节点上,每个工作负载都有不同的资源和运行时要求。在本文中,我们声称单个操作系统/运行时 (OS/R) 无法有效管理这些工作负载。因此,我们推出了 Pisces,这是一种系统软件架构,可以实现多个独立且完全隔离的 OS/R 或 enclave 的共存,这些 OS/R 或 enclave 可以进行定制,以满足下一代 HPC 工作负载的不同需求。每个飞地由专门的轻量级操作系统协同内核和运行时组成,能够独立管理动态分配的硬件资源的分区。与其他共内核方法相反,在这项工作中,我们认为性能隔离是主要要求,并提出了一种新颖的共内核架构来实现这一目标。我们进一步提出了一组确保性能隔离所需的设计要求,包括:(1)消除跨操作系统依赖性,(2)I/O 内部化管理,(3)将跨安全区通信限制为显式共享内存通道,以及(4)使用虚拟化技术来提供缺失的操作系统功能。 Pisces 共内核架构的实现基于 Kitten Lightweight Kernel 和 Palacios Virtual Machine Monitor 这两种专为 HPC 系统设计的系统软件架构。最后,我们将展示轻量级隔离的协同内核可以为 HPC 应用程序提供更好的性能,并且隔离的虚拟机甚至能够在存在竞争工作负载的情况下超越本机环境。
Performance isolation is emerging as a requirement for High Performance Computing (HPC) applications, particularly as HPC architectures turn to in situ data processing and application composition techniques to increase system throughput. These approaches require the co-location of disparate workloads on the same compute node, each with different resource and runtime requirements. In this paper we claim that these workloads cannot be effectively managed by a single Operating System/Runtime (OS/R). Therefore, we present Pisces, a system software architecture that enables the co-existence of multiple independent and fully isolated OS/Rs, or enclaves, that can be customized to address the disparate requirements of next generation HPC workloads. Each enclave consists of a specialized lightweight OS co-kernel and runtime, which is capable of independently managing partitions of dynamically assigned hardware resources. Contrary to other co-kernel approaches, in this work we consider performance isolation to be a primary requirement and present a novel co-kernel architecture to achieve this goal. We further present a set of design requirements necessary to ensure performance isolation, including: (1) elimination of cross OS dependencies, (2) internalized management of I/O, (3) limiting cross enclave communication to explicit shared memory channels, and (4) using virtualization techniques to provide missing OS features. The implementation of the Pisces co-kernel architecture is based on the Kitten Lightweight Kernel and Palacios Virtual Machine Monitor, two system software architectures designed specifically for HPC systems. Finally we will show that lightweight isolated co-kernels can provide better performance for HPC applications, and that isolated virtual machines are even capable of outperforming native environments in the presence of competing workloads.