CodedBulk: Inter-Datacenter Bulk Transfers using Network Coding
CodedBulk: Inter-Datacenter Bulk Transfers using Network Coding
复制标题
DOI：
--
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Shih-Hao Tseng;Saksham Agarwal;R. Agarwal;Hitesh Ballani;A. Tang
中科院分区：
文献类型：
--
作者：
Shih-Hao Tseng;Saksham Agarwal;R. Agarwal;Hitesh Ballani;A. Tang
本文介绍了CodedBulk，一种用于数据中心间大容量传输的高吞吐量系统。CodedBulk的核心是使用网络编码，这是一种来自编码理论领域的技术，它能保证单个大容量传输的最佳吞吐量。先前在有线网络中使用网络编码的尝试面临着一些实际和根本性的障碍。CodedBulk通过利用数据中心间网络的独特属性，并使用一种定制设计的逐跳流量控制机制来解决这些障碍，这种机制能够在现有传输协议之上高效地实现网络编码。在一个地理分布式数据中心间网络上运行的端到端CodedBulk实现，与不使用网络编码的最先进机制相比，将大容量传输吞吐量提高了1.2 - 2.5倍。
This paper presents CodedBulk, a system for high-throughput inter-datacenter bulk transfers. At its core, CodedBulk uses network coding, a technique from the coding theory community, that guarantees optimal throughput for individual bulk transfers. Prior attempts to using network coding in wired networks have faced several pragmatic and fundamental barriers. CodedBulk resolves these barriers by exploiting the unique properties of inter-datacenter networks, and by using a custom-designed hop-by-hop flow control mechanism that enables efficient realization of network coding atop existing transport protocols. An end-to-end CodedBulk implementation running on a geo-distributed inter-datacenter network improves bulk transfer throughput by 1.2−2.5× compared to state-of-the-art mechanisms that do not use network coding.