Analyzing Network Health and Congestion in Dragonfly-Based Supercomputers
Analyzing Network Health and Congestion in Dragonfly-Based Supercomputers
复制标题
分析基于 Dragonfly 的超级计算机中的网络健康状况和拥塞情况
DOI：
10.1109/ipdps.2016.123
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
P. Bremer
中科院分区：
文献类型：
--
作者：
A. Bhatele;Nikhil Jain;Y. Livnat;Valerio Pascucci;P. Bremer
蜻蜓拓扑是构建高基数、小直径、具有高带宽链路的分层网络的常用选择。在蜻蜓网络的Cray安装上，工作安置策略和路由效率低下可能会导致单个作业和多个作业工作负载的严重网络拥塞。在本文中，我们探讨了作业安置、并行工作负载和网络配置对网络健康的影响，以期更好地理解作业间干扰。我们开发了一个功能性网络模拟器Damselly来模拟Cray Cascade的网络行为，并开发了一个可视化分析工具DragonView来分析模拟结果。我们根据多达131,072个内核上的五种典型通信模式模拟了几个并行工作负载。我们的模拟和可视化为网络拥塞的形成提供了独特的洞察力，并提供了部署成本和网络性能之间的权衡。
The dragonfly topology is a popular choice for building high-radix, low-diameter, hierarchical networks with high-bandwidth links. On Cray installations of the dragonfly network, job placement policies and routing inefficiencies can lead to significant network congestion for a single job and multi-job workloads. In this paper, we explore the effects of job placement, parallel workloads and network configurations on network health to develop a better understanding of inter-job interference. We have developed a functional network simulator, Damselfly, to model the network behavior of Cray Cascade, and a visual analytics tool, DragonView, to analyze the simulation output. We simulate several parallel workloads based on five representative communication patterns on up to 131,072 cores. Our simulations and visualizations provide unique insight into the buildup of network congestion and present a trade-off between deployment dollar costs and performance of the network.