Optimizing Data-intensive Systems in Disaggregated Data Centers with TELEPORT
Optimizing Data-intensive Systems in Disaggregated Data Centers with TELEPORT
复制标题
DOI：
10.1145/3514221.3517856
复制
发表时间：
2022-06
期刊：
影响因子：
--
通讯作者：
Qizhen Zhang;Xinyi Chen;Sidharth S Sankhe;Zhi-Yun Zheng;Ke Zhong;Sebastian Angel;Ang Chen;Vincent Liu;B. T. Loo
中科院分区：
文献类型：
--
作者：
Qizhen Zhang;Xinyi Chen;Sidharth S Sankhe;Zhi-Yun Zheng;Ke Zhong;Sebastian Angel;Ang Chen;Vincent Liu;B. T. Loo
最近提出的在数据中心中分解计算、内存、存储和加速器的建议有望带来实质性的运营效益。不幸的是，对于像内存这样的资源，这是以性能开销为代价的，因为每个加载和存储操作都可能插入网络延迟。这种影响在数据密集型系统中尤为明显，因为它们的工作集很大，需要访问内存的频率很高，每次访问的计算量相对较低。这种性能损害抵消了分散内存的弹性优势。本文介绍了TELEPORT，一个计算下推框架的数据密集型系统，运行在分散的架构;相比以前的工作计算下推，TELEPORT是独特的效率和灵活性。我们已经为几个流行的系统开发了优化原则，包括列式内存数据库管理系统、图形处理系统和MapReduce系统。评估结果表明，使用TELEPORT推下简单的运营商，提高了这些系统的性能在国家的最先进的分散操作系统的数量级，从而充分利用分散的数据中心的弹性。
Recent proposals for the disaggregation of compute, memory, storage, and accelerators in data centers promise substantial operational benefits. Unfortunately, for resources like memory, this comes at the cost of performance overhead due to the potential insertion of network latency into every load and store operation. This effect is particularly felt by data-intensive systems due to the size of their working sets, the frequency at which they need to access memory, and the relatively low computation per access. This performance impairment offsets the elasticity benefit of disaggregated memory. This paper presents TELEPORT, a compute pushdown framework for data-intensive systems that run on disaggregated architectures; compared to prior work on compute pushdown, TELEPORT is unique in its efficiency and flexibility. We have developed optimization prin- ciples for several popular systems including a columnar in-memory DBMS, a graph processing system, and a MapReduce system. The evaluation results show that using TELEPORT to push down simple operators improves the performance of these systems on state-of-the-art disaggregated OSes by an order of magnitude, thus fully exploiting the elasticity of disaggregated data centers.