Unleashing True Utility Computing with Quicksand
Unleashing True Utility Computing with Quicksand
复制标题
DOI：
10.1145/3593856.3595893
复制
发表时间：
2023-06
期刊：
影响因子：
--
通讯作者：
Zhenyuan Ruan;Shihang Li;Kaiyan Fan;M. Aguilera;A. Belay;S. Park;Malte Schwarzkopf
中科院分区：
文献类型：
--
作者：
Zhenyuan Ruan;Shihang Li;Kaiyan Fan;M. Aguilera;A. Belay;S. Park;Malte Schwarzkopf
当今的云计算效率低下：它们对CPU、GPU、内存和存储等资源的利用率很低。这种低效率的发生是因为应用程序以可变的速率和比率消耗资源，而云以固定的速率和比率提供资源。这种提供和消费方式的不匹配阻碍了效用计算愿景的充分实现。我们提倡可替代的应用程序，也就是说，应用程序可以独立地分发、扩展和迁移其对不同资源的消耗，同时在不同的服务器上适应其可用性（例如，一台服务器上的内存，另一台服务器上的CPU）。我们的目标是充分利用资源，即使它们在服务器上仅短暂可用几毫秒。我们正在开发一个名为Quicksand的框架，用于构建此类应用程序并释放效用计算愿景。使用Quicksand实现DNN训练管道的初步结果是有希望的：Quicksand饱和了机器之间不平衡或数量快速变化的资源。
Today's clouds are inefficient: their utilization of resources like CPUs, GPUs, memory, and storage is low. This inefficiency occurs because applications consume resources at variable rates and ratios, while clouds offer resources at fixed rates and ratios. This mismatch of offering and consumption styles prevents fully realizing the utility computing vision. We advocate for fungible applications, that is, applications that can distribute, scale, and migrate their consumption of different resources independently while fitting their availability across different servers (e.g., memory at one server, CPU at another). Our goal is to make use of resources even if they are transiently available on a server for only a few milliseconds. We are developing a framework called Quicksand for building such applications and unleashing the utility computing vision. Initial results using Quicksand to implement a DNN training pipeline are promising: Quicksand saturates resources that are imbalanced across machines or rapidly shift in quantity.