An Inter-Data Encoding Technique that Exploits Synchronized Data for Network Applications
An Inter-Data Encoding Technique that Exploits Synchronized Data for Network Applications
复制标题
DOI：
10.1109/tmc.2019.2940578
复制
发表时间：
2021-01
影响因子：
7.9
通讯作者：
Wooseung Nam;Joohyung Lee;N. Shroff;Kyunghan Lee
中科院分区：
文献类型：
--
作者：
Wooseung Nam;Joohyung Lee;N. Shroff;Kyunghan Lee
在各种网络应用中，存在着大量的共享数据在两个终端主机之间。示例包括将数据从一个节点复制到另一个节点的数据同步服务。考虑到共享数据可能与要传输的新数据具有高度相关性，我们质疑如何最好地利用这种共享数据来提高数据传输的效率。为了回答这个问题，我们开发了一种数据间编码技术，SyncCoding，它有效地替换了要传输的数据的位序列，并将其与共享数据中的位序列相匹配，称为引用。通过这样做，SyncCoding可以减少数据流量，加快数据传输速度，并节省传输能耗。我们对在Linux中实现的SyncCoding的评估表明，它优于现有的流行编码技术，Brotli，LZMA，Deflate，和P2P。在云存储场景中压缩后的数据大小方面，SyncCoding相对于这些技术的收益分别约为12.5%、20.8%、30.1%和66.1%，在Web浏览场景中分别约为78.4%、80.3%、84.3%和94.3%。
In a variety of network applications, there exists a significant amount of shared data between two end hosts. Examples include data synchronization services that replicate data from one node to another. Given that shared data may have a high correlation with new data to transmit, we question how such shared data can be best utilized to improve the efficiency of data transmission. To answer this, we develop an inter-data encoding technique, SyncCoding, that effectively replaces bit sequences of the data to be transmitted with the pointers to their matching bit sequences in the shared data so called references. By doing so, SyncCoding can reduce data traffic, speed up data transmission, and save energy consumption for transmission. Our evaluations of SyncCoding implemented in Linux show that it outperforms existing popular encoding techniques, Brotli, LZMA, Deflate, and Deduplication. The gains of SyncCoding over those techniques in the perspective of data size after compression in a cloud storage scenario are about 12.5, 20.8, 30.1, and 66.1 percent, and are about 78.4, 80.3, 84.3, and 94.3 percent in a web browsing scenario, respectively.