Impact of Noise on Scaling of Collectives: An Empirical Evaluation
Impact of Noise on Scaling of Collectives: An Empirical Evaluation
复制标题
噪音对集体规模的影响：实证评估
DOI：
--
复制
发表时间：
2006
期刊：
影响因子：
--
通讯作者：
Pradipta De
中科院分区：
文献类型：
--
作者：
R. Garg;Pradipta De
越来越明显的是，以守护进程活动和中断的形式出现的操作系统干扰对大型集群中的并行应用程序的性能下降有显著的影响。早期的理论研究评估了系统噪声对不同噪声分布的应用性能的影响[1]。我们的工作补充了理论分析，提出了一个实证研究的噪声在生产集群。我们设计了一个并行基准测试，用于在Sandigo超级计算中心的大型集群上收集与噪声相关的数据。这些数据被馈送到模拟器，该模拟器使用[1]的模型预测集体操作的性能。我们报告我们的预测和观察到的性能的比较。此外，在此过程中开发的工具有助于识别异常节点，这些节点如果未被检测到，可能会影响应用程序的性能。
It is increasingly becoming evident that operating system interference in the form of daemon activity and interrupts contribute significantly to performance degradation of parallel applications in large clusters. An earlier theoretical study has evaluated the impact of system noise on application performance for different noise distributions [1]. Our work complements the theoretical analysis by presenting an empirical study of noise in production clusters. We designed a parallel benchmark that was used on large clusters at SanDeigo Supercomputing Center for collecting noise related data. This data was fed to a simulator that predicts the performance of collective operations using the model of [1]. We report our comparison of the predicted and the observed performance. Additionally, the tools developed in the process have been instrumental in identifying anomalous nodes that could potentially be affecting application performance if undetected.