CSR: Eager: HPC Virtualization with SR-IOV

最近为InfiniBand和高速以太网引入的单根I/O虚拟化（SR-IOV）技术提供了本地I/O虚拟化功能，并使我们能够在多个虚拟机（vm）之间提供内部pci总线接口。然而，在使用SR-IOV的虚拟化多核系统上使用点对点和集体操作的HPC应用程序实现接近本机的吞吐量，对高性能中间件（如MPI）的设计者提出了一系列新的挑战。为了解决这一问题，本项目旨在解决以下一系列挑战：1)如何重新设计MPI通信库，以实现高效的位置感知通信，并促进现代虚拟化高性能集群上SR-IOV的公平资源共享？2)通信库是否可以设计为跨不同VM订阅策略和网络通信模式提供最佳通信性能？3)在设计对高级特性（如实时迁移、服务质量和I/O存储虚拟化）的支持时所涉及的挑战是什么？4)在性能和可扩展性方面，提出的HPC应用程序方法可以实现什么样的好处？本文提出了一个协同的综合研究计划，以解决基于SR-IOV集群的HPC虚拟化的上述挑战，并研究其对一系列HPC应用的影响。

The recently introduced Single Root I/O Virtualization (SR-IOV)technique for InfiniBand and High Speed Ethernet provides native I/Ovirtualization capabilities and enables us to provision the internalPCI bus interface between multiple Virtual Machines (VMs). However,achieving near native throughput for HPC applications that use bothpoint-to-point and collective operations on virtualized multi-coresystems with SR-IOV presents a new set of challenges for the designersof high performance middleware, such as MPI. In order to solve thisproblem, this project aims to address the following set of challenges:1) How to redesign MPI communication library to achieve efficientlocality-aware communication and facilitate fair resource sharing onmodern virtualized high performance clusters, with SR-IOV? 2) Cancommunication libraries be designed to deliver the best communicationperformance across different VM subscription policies and networkcommunication modes? 3) What are the the challenges involved indesigning support for advanced features such as, live migration,Quality of Service, and I/O storage virtualization? and 4) What kindof benefits, in terms of performance and scalability, can be achievedby the proposed approach for HPC applications? A synergistic andcomprehensive research plan is proposed to address the abovechallenges for HPC Virtualization on clusters with SR-IOV and studyits impact for a set of HPC applications.