Quiet Neighborhoods: Key to Protect Job Performance Predictability

Quiet Neighborhoods: Key to Protect Job Performance Predictability
复制标题

安静的社区:保护工作绩效可预测性的关键

DOI:
10.1109/ipdps.2015.87
复制
发表时间:
2015
期刊:
2015 IEEE International Parallel and Distributed Processing Symposium
影响因子:
--
通讯作者:
J. Labarta
J. Labarta
中科院分区:
--
文献类型:
--
作者:
Ana Jokanovic;J. Sancho;G. Rodríguez;A. Lucero;C. Minkenberg;J. Labarta

文献摘要

被引文献

相似文献

附近作业的干扰最近已被确定为高性能计算(HPC)系统上运行的并行应用程序的高性能可变性的主要原因。通常,HPC系统是动态的,多个作业以不可预测的方式进入和离开,同时共享系统互连网络。在这样的环境中,对网络资源的争用会导致应用程序执行过程中的随机停顿,从而降低应用程序和系统的整体性能。消除其邻近区域中的作业交互是保证应用程序性能可预测性的关键。在本文中,我们提出了安静的社区,显着减少工作互动的概念。安静的街区由系统资源管理器分两个阶段创建。首先,基于典型的工作负载分布在物理网络资源之上定义多个虚拟网络块。第二,新到达的作业根据它们的大小被分配到这些虚拟块中。
Interference of nearby jobs has been recently identified as the dominant reason for the high performance variability of parallel applications running on High Performance Computing (HPC) systems. Typically, HPC systems are dynamic with multiple jobs coming and leaving in an unpredictable fashion, sharing simultaneously the system interconnection network. In such environment contention for network resources is causing random stalls in the progress of application execution degrading application and system performance overall. Eliminating job interactions in their neighbourhoods is key for guaranteeing performance predictability of applications. In this paper we are proposing the concept of quiet neighbourhoods that significantly reduce job interactions. Quiet neighbourhoods are created by the system resource manager in two phases. First, multiple virtual network blocks are defined on the top of the physical network resources based on typical workload distributions. Second, newly arriving jobs are allocated in these virtual blocks based on their size.