Pilgrim: Scalable and (near) lossless MPI Tracing
Pilgrim: Scalable and (near) lossless MPI Tracing
复制标题
DOI：
10.1145/3458817.3476151
复制
发表时间：
2021-11
期刊：
影响因子：
--
通讯作者：
Chen Wang;P. Balaji;M. Snir
中科院分区：
文献类型：
--
作者：
Chen Wang;P. Balaji;M. Snir
MPI通信的跟踪被许多性能分析和可视化工具使用。存储大规模MPI应用程序的详尽跟踪是不可行的，因为它们的体积很大。聚合或有损MPI跟踪较小，但提供的信息少得多。在本文中，我们提出了朝圣者，一个近乎无损的MPI跟踪工具，招致适度的开销，并产生小的跟踪文件在大规模，通过使用先进的压缩技术。此外，对于具有规则通信模式的代码，Pilgrim可以将其轨迹存储在恒定空间中，而不管问题大小、处理器数量和迭代次数。与现有的工具相比，Pilgrim在我们测试的所有程序中以更少的空间保留了更多的信息。
Traces of MPI communications are used by many performance analysis and visualization tools. Storing exhaustive traces of large scale MPI applications is infeasible, due to their large volume. Aggregated or lossy MPI traces are smaller, but provide much less information. In this paper, we present Pilgrim, a near lossless MPI tracing tool that incurs moderate overheads and generates small trace files at large scales, by using sophisticated compression techniques. Furthermore, for codes with regular communication patterns, Pilgrim can store their traces in constant space regardless of the problem size, the number of processors, and the number of iterations. In comparison with existing tools, Pilgrim preserves more information with less space in all the programs we tested.