Mitigating network noise on Dragonfly networks through application-aware routing

Mitigating network noise on Dragonfly networks through application-aware routing
复制标题

通过应用感知路由减轻 Dragonfly 网络上的网络噪声

DOI:
10.1145/3295500.3356196
复制
发表时间:
2019
期刊:
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
影响因子:
--
通讯作者:
T. Hoefler
T. Hoefler
中科院分区:
--
文献类型:
--
作者:
D. D. Sensi;S. D. Girolamo;T. Hoefler

文献摘要

参考文献

被引文献

相似文献

系统噪声会对HPC系统的性能产生负面影响,而互连网络是导致这一问题的主要因素之一。为了减轻这种影响,自适应路由在拥塞程度较低的非最小路径上发送数据包。然而,虽然这可以减轻由拥塞引起的干扰,但它也会产生更多的流量,因为数据包会经过额外的跳,从而导致其他应用程序和应用程序本身的拥塞。在本文中,我们首先描述如何估计网络噪声。通过遵循这些准则,我们展示了如何通过使用路由算法来减少噪声,该算法以较高的概率选择最小路径。我们利用这些知识来设计一个算法,根据应用程序的特点改变选择最小路径的概率。我们验证了我们的解决方案的微基准和现实世界中的应用程序依赖于一个蜻蜓互连网络的两个系统,显示降噪和性能提高。
System noise can negatively impact the performance of HPC systems, and the interconnection network is one of the main factors contributing to this problem. To mitigate this effect, adaptive routing sends packets on non-minimal paths if they are less congested. However, while this may mitigate interference caused by congestion, it also generates more traffic since packets traverse additional hops, causing in turn congestion on other applications and on the application itself. In this paper, we first describe how to estimate network noise. By following these guidelines, we show how noise can be reduced by using routing algorithms which select minimal paths with a higher probability. We exploit this knowledge to design an algorithm which changes the probability of selecting minimal paths according to the application characteristics. We validate our solution on microbenchmarks and real-world applications on two systems relying on a Dragonfly interconnection network, showing noise reduction and performance improvement.
Dragonfly 系统上本地化通信和平衡网络流量的权衡研究
DOI: --
发表时间: 2018
期刊: IPDPS .... [proceedings]
影响因子: --
作者:
Wang, Xin;Mubarak, Misbah;Yang, Xu;Ross, Rob;Lan, Zhiling
通讯作者: Lan, Zhiling