TriEC: tripartite graph based erasure coding NIC offload
TriEC: tripartite graph based erasure coding NIC offload
复制标题
DOI：
10.1145/3295500.3356178
复制
发表时间：
2019-11
期刊：
影响因子：
--
通讯作者：
Haiyang Shi;Xiaoyi Lu
中科院分区：
文献类型：
--
作者：
Haiyang Shi;Xiaoyi Lu
擦除编码（EC）NIC卸载是设计下一代分布式存储系统的一项很有前途的技术。然而，本文确定了现代SmartDisk上当前一代EC NIC卸载方案的三个主要局限性。因此，本文提出了一种新的EC NIC卸载范式的基础上的三方图模型，即TriEC。TriEC有效地支持编码和发送以及接收和解码操作。通过基于定理的证明，与memcached（即，TriEC-Cache）和大量实验，我们证明了TriEC是正确的，并且可以提供比最先进的EC NIC卸载方案（即，BiEC）。基准测试表明，TriEC在编码和恢复方面分别比BiEC高出1.82倍和2.33倍。借助扩展的YCSB工作负载，TriEC可将平均写入延迟减少多达23.2%，恢复时间减少多达37.8%。TriEC在800万条记录的全节点恢复方面的性能是BiEC的1.32倍。
Erasure Coding (EC) NIC offload is a promising technology for designing next-generation distributed storage systems. However, this paper has identified three major limitations of current-generation EC NIC offload schemes on modern SmartNICs. Thus, this paper proposes a new EC NIC offload paradigm based on the tripartite graph model, namely TriEC. TriEC supports both encode-and-send and receive-and-decode operations efficiently. Through theorem-based proofs, co-designs with memcached (i.e., TriEC-Cache), and extensive experiments, we show that TriEC is correct and can deliver better performance than the state-of-the-art EC NIC offload schemes (i.e., BiEC). Benchmark evaluations demonstrate that TriEC outperforms BiEC by up to 1.82x and 2.33x for encoding and recovering, respectively. With extended YCSB workloads, TriEC reduces the average write latency by up to 23.2% and the recovery time by up to 37.8%. TriEC outperforms BiEC by 1.32x for a full-node recovery with 8 million records.