Cloud-scale VM-deflation for Running Interactive Applications On Transient Servers

Cloud-scale VM-deflation for Running Interactive Applications On Transient Servers
复制标题

DOI:
10.1145/3369583.3392675
复制
发表时间:
2020-05
期刊:
Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing
影响因子:
--
通讯作者:
Alexander Fuerst;Ahmed Ali-Eldin;Prashant J. Shenoy;Prateek Sharma
Alexander Fuerst;Ahmed Ali-Eldin;Prashant J. Shenoy;Prateek Sharma
中科院分区:
其他
文献类型:
--
作者:
Alexander Fuerst;Ahmed Ali-Eldin;Prashant J. Shenoy;Prateek Sharma

文献摘要

相似文献

瞬态计算已在公共云环境中变得流行,用于以低成本运行对延迟不敏感的批处理和数据处理应用程序。由于瞬态云服务器可以随时被云提供商撤销,因此它们被认为不适合运行Web服务等交互式应用程序。在本文中,我们将虚拟机通缩作为服务器抢占的替代机制,用于在资源压力下从瞬态云服务器回收资源。使用来自顶级云提供商的真实痕迹,我们展示了使用虚拟机通货紧缩作为公共云中交互式应用程序的资源回收机制的可行性。我们展示了如何使用当前的虚拟机管理程序机制来实现虚拟机紧缩,并为瞬态和按需云虚拟机的资源管理提供集群紧缩策略。在 Linux 集群上对我们的缩减系统进行的实验评估表明,基于微服务的应用程序可以缩减高达 50% 的性能开销,而性能开销可以忽略不计。我们的集群级通缩策略允许超载水平高达 50%,应用程序吞吐量下降不到 1%,并且可以使云平台收入增加 30%。
Transient computing has become popular in public cloud environments for running delay-insensitive batch and data processing applications at low cost. Since transient cloud servers can be revoked at any time by the cloud provider, they are considered unsuitable for running interactive application such as web services. In this paper, we present VM deflation as an alternative mechanism to server preemption for reclaiming resources from transient cloud servers under resource pressure. Using real traces from top-tier cloud providers, we show the feasibility of using VM deflation as a resource reclamation mechanism for interactive applications in public clouds. We show how current hypervisor mechanisms can be used to implement VM deflation and present cluster deflation policies for resource management of transient and on-demand cloud VMs. Experimental evaluation of our deflation system on a Linux cluster shows that microservice-based applications can be deflated by up to 50% with negligible performance overhead. Our cluster-level deflation policies allow overcommitment levels as high as 50%, with less than a 1% decrease in application throughput, and can enable cloud platforms to increase revenue by 30%.