SpotWeb: Running Latency-sensitive Distributed Web Services on Transient Cloud Servers

SpotWeb: Running Latency-sensitive Distributed Web Services on Transient Cloud Servers
复制标题

DOI:
10.1145/3307681.3325397
复制
发表时间:
2019-06
期刊:
Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing
影响因子:
--
通讯作者:
Ahmed Ali-Eldin;Jonathan Westin;Bin Wang;Prateek Sharma;Prashant J. Shenoy
Ahmed Ali-Eldin;Jonathan Westin;Bin Wang;Prateek Sharma;Prashant J. Shenoy
中科院分区:
其他
文献类型:
--
作者:
Ahmed Ali-Eldin;Jonathan Westin;Bin Wang;Prateek Sharma;Prashant J. Shenoy

文献摘要

被引文献

相似文献

许多云提供商以较低的成本提供具有瞬时可用性的服务器。这些服务器可以由提供商单方面撤销,通常是在向用户发出警告后。直到最近,人们还认为这些服务器由于其瞬时可用性而不适合运行延迟敏感的工作负载。在本文中,我们介绍了SpotWeb,一个框架,用于在瞬态计算平台上运行延迟敏感的Web工作负载,同时保持运行应用程序的服务质量(QoS)。SpotWeb基于三个新颖的概念:使用多周期优化(一种在金融领域开发的新颖方法)进行服务器选择;瞬时感知负载平衡;以及使用智能容量过度配置。我们实现了SpotWeb并在模拟和测试台实验中评估了其性能。我们的研究结果表明,与最先进的解决方案相比,SpotWeb降低了高达50%的成本,同时可扩展到数百个云服务器配置。
Many cloud providers offer servers with transient availability at a reduced cost. These servers can be unilaterally revoked by the provider, usually after a warning period to the user. Until recently, it has been thought that these servers are not suitable to run latency-sensitive workloads due to their transient availability. In this paper, we introduce SpotWeb, a framework for running latency-sensitive web workloads on transient computing platforms while maintaining the Quality-of-Service (QoS) of the running applications. SpotWeb is based on three novel concepts; using multi-period optimization---a novel approach developed in finance---for server selection; transiency-aware load-balancing; and using intelligent capacity over-provisioning. We implement SpotWeb and evaluate its performance in both simulations and testbed experiments. Our results show that SpotWeb reduces costs by up to 50% compared to state-of-the-art solutions while being scalable to hundreds of cloud server configurations.