Harmonia: An Interference-Aware Dynamic I/O Scheduler for Shared Non-volatile Burst Buffers
Harmonia: An Interference-Aware Dynamic I/O Scheduler for Shared Non-volatile Burst Buffers
复制标题
DOI：
10.1109/cluster.2018.00046
复制
发表时间：
2018-09
期刊：
影响因子：
--
通讯作者：
Anthony Kougkas;H. Devarajan;Xian-He Sun;J. Lofstead
中科院分区：
文献类型：
--
作者：
Anthony Kougkas;H. Devarajan;Xian-He Sun;J. Lofstead
现代 HPC 系统采用突发缓冲区安装来降低外部存储的峰值 I/O 需求，并处理现代科学应用中的 I/O 突发性。这些 I/O 缓冲资源在并发运行的多个应用程序之间共享。这会因争用而导致性能严重下降，这种现象称为跨应用程序 I/O 干扰。在本文中，我们首先探讨了突发缓冲层干扰的负面影响，并提出了两个新指标，可以定量描述干扰造成的应用程序减速体验。我们引入了 Harmonia，这是一种新的动态 I/O 调度程序，它能够感知干扰、适应底层系统、实现新的 2 路决策过程并采用多种调度策略来最大限度地提高系统效率和应用程序性能。我们的评估表明，通过更好的 I/O 调度，Harmonia 的性能可以比现有最先进的缓冲管理解决方案高出 3 倍，并且可以提高资源利用率。
Modern HPC systems employ burst buffer installations to reduce the peak I/O requirements for external storage and deal with the burstiness of I/O in modern scientific applications. These I/O buffering resources are shared between multiple applications that run concurrently. This leads to severe performance degradation due to contention, a phenomenon called cross-application I/O interference. In this paper, we first explore the negative effects of interference at the burst buffer layer and we present two new metrics that can quantitatively describe the slowdown applications experience due to interference. We introduce Harmonia, a new dynamic I/O scheduler that is aware of interference, adapts to the underlying system, implements a new 2-way decision-making process and employs several scheduling policies to maximize the system efficiency and applications' performance. Our evaluation shows that Harmonia, through better I/O scheduling, can outperform by 3x existing state-of-the-art buffering management solutions and can lead to better resource utilization.