A Virtualization Platform Designed for Irregular Multi-Process Applications
A Virtualization Platform Designed for Irregular Multi-Process Applications
复制标题
专为不规则多进程应用设计的虚拟化平台
DOI：
--
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Panruo Wu
中科院分区：
文献类型：
--
作者：
Pavan Guangli Dai;Kumar Paluri;Albert Mo;Kim Cheng;Panruo Wu
许多高性能计算应用程序都涉及多进程编程。虽然并行运行的多个进程可以极大地减少应用程序的完成时间，但在许多不规则的应用程序中，不同进程上的工作负载可能会有很大差异，因此不平衡。不规则的应用程序是不平衡的，因为当为每个进程分配一个单独的CPU时，具有较小工作负载的进程必须被挂起以等待具有较大工作负载的进程。由于这种不平衡的工作负载可能会导致计算资源的巨大浪费，因此我们提出了针对这些非常规应用的RRP-Xen虚拟化平台。具体地说，RRP-Xen可以将工作负载较小的多个进程从一个或多个不规则应用程序集群到同一个CPU上。与其他也涉及虚拟化的HPC云解决方案相比，RRP-Xen可以为每个进程提供实时性能保证。因此，可以减少部署多个非常规应用程序所需的CPU数量，而每个非常规应用程序的完成只经历很小的延迟。
Many High-Performance Computing applications involve multi-process programming. While multiple processes running in parallel can greatly reduce the completion time of applications, there are many irregular applications where the workloads on different processes may vary significantly and thus are not balanced. An irregular application is unbalanced in the sense that processes with smaller workloads have to be suspended to wait for processes with larger workloads when each process is allocated a sole CPU. Since such unbalanced workloads can lead to a tremendous waste of computational resources, we propose the RRP-Xen virtualization platform for these irregular applications. Specifically, RRP-Xen can cluster multiple processes with small workloads from one or more irregular applications onto the same CPU. Compared to other HPC cloud solutions, which also involve virtualization, RRP-Xen can offer real-timeperformanceguaranteesto each process. Consequently, the number of CPUs needed for deploying multiple irregular applications can be reduced while the completion of each irregular application experiences only minor delays.