Can Inter-VM Shmem Benefit MPI Applications on SR-IOV Based Virtualized Infiniband Clusters?
Can Inter-VM Shmem Benefit MPI Applications on SR-IOV Based Virtualized Infiniband Clusters?
复制标题
VM 间 Shmem 能否使基于 SR-IOV 的虚拟化 Infiniband 集群上的 MPI 应用程序受益？
DOI：
10.1007/978-3-319-09873-9_29
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
D. Panda
中科院分区：
文献类型：
--
作者：
Jie Zhang;Xiaoyi Lu;Jithin Jose;Rong Shi;D. Panda
单根 I/O 虚拟化 (SR-IOV) 技术已被引入用于 InfiniBand 等高性能互连。最近的研究主要集中在高性能通信中间件（例如 MPI）的性能特征以及支持 SR-IOV 的 HPC 集群上的应用程序。然而，当前基于 SR-IOV 的 MPI 应用程序并未利用主机内 VM 间环境中的位置感知通信。尽管虚拟机间共享内存 (IVShmem) 已被证明可以支持高效的位置感知通信，但 IVShmem 在虚拟化环境中为 MPI 库带来的性能优势仍有待探索。在本文中，我们使用微基准和 HPC 应用程序对 IVShmem 支持的 MPI 进行了全面的性能评估。性能评估表明，通过IVShmem，MPI点对点和集合操作的性能分别可以提高193%和91%。与SR-IOV相比，应用性能可提高高达96%。结果进一步表明，与本机环境相比，IVShmem 仅带来很小的开销。
Single Root I/O Virtualization (SR-IOV) technology has been introduced for high-performance interconnects such as InfiniBand. Recent studies mainly focus on performance characteristics of high-performance communication middleware (e.g. MPI) and applications on SR-IOV enabled HPC clusters. However, current SR-IOV based MPI applications do not take advantage of the locality-aware communication on intra-host inter-VM environment. Although Inter-VM Shared Memory (IVShmem) has been proven to support efficient locality-aware communication, the performance benefits of IVShmem for MPI libraries on virtualized environments are yet to be explored. In this paper, we present a comprehensive performance evaluation for IVShmem backed MPI using micro-benchmarks and HPC applications. The performance evaluations show that, through IVShmem, the performance of MPI point-to-point and collective operations can be improved up to 193% and 91%, respectively. The application performance can be improved up to 96%, compared to SR-IOV. The results further show that IVShmem just brings minor overhead compared to native environment.