The Who, What, Why, and How of High Performance Computing in the Cloud
The Who, What, Why, and How of High Performance Computing in the Cloud
复制标题
云中高性能计算的人物、内容、原因和方式
DOI：
--
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
D. Milojicic
中科院分区：
文献类型：
--
作者：
Abhishek K. Gupta;L. Kalé;F. Gioachin;Verdi March;Chun Hui Suen;Bu;P. Faraboschi;R. Kaufmann;D. Milojicic
云计算正在成为超级计算机的替代品，用于一些不需要完全专用机器的高性能计算（HPC）应用程序。随着云作为额外的部署选项，HPC用户面临着处理高度异构资源的挑战，其中可变性跨越各种处理器配置，互连，虚拟化环境以及定价率和模型。在本文中，我们从整体的角度来回答这个问题--为什么以及谁应该选择云来进行高性能计算、用于哪些应用程序以及如何将云用于高性能计算？为此，我们对一系列平台上的一组基准测试和复杂HPC应用程序进行了全面的性能评估和分析，从超级计算机到云。此外，我们还展示了使用替代轻量级虚拟化机制（瘦虚拟机和操作系统级容器以及hyper visor和应用程序级CPU亲和性）在云中的HPC性能改进。接下来，我们将分析云中HPC的经济方面和商业模式。我们认为，这是一个过去研究没有充分解决的重要领域。总体结果表明，当孤立地考虑时，当前的公共云仅在小规模上对所选HPC应用具有成本效益，但可以使用云爆发和应用感知映射等业务模型来补充超级计算机。
Cloud computing is emerging as an alternative to supercomputers for some of the high-performance computing (HPC) applications that do not require a fully dedicated machine. With cloud as an additional deployment option, HPC users are faced with the challenges of dealing with highly heterogeneous resources, where the variability spans across a wide range of processor configurations, interconnections, virtualization environments, and pricing rates and models. In this paper, we take a holistic viewpoint to answer the question - why and who should choose cloud for HPC, for what applications, and how should cloud be used for HPC? To this end, we perform a comprehensive performance evaluation and analysis of a set of benchmarks and complex HPC applications on a range of platforms, varying from supercomputers to clouds. Further, we demonstrate HPC performance improvements in cloud using alternative lightweight virtualization mechanisms - thin VMs and OS-level containers, and hyper visor- and application-level CPU affinity. Next, we analyze the economic aspects and business models for HPC in clouds. We believe that is an important area that has not been sufficiently addressed by past research. Overall results indicate that current public clouds are cost-effective only at small scale for the chosen HPC applications, when considered in isolation, but can complement supercomputers using business models such as cloud burst and application-aware mapping.