EC-Bench: Benchmarking Onload and Offload Erasure Coders on Modern Hardware Architectures
EC-Bench: Benchmarking Onload and Offload Erasure Coders on Modern Hardware Architectures
复制标题
DOI：
10.1007/978-3-030-32813-9_18
复制
发表时间：
2018-12
期刊：
影响因子：
--
通讯作者：
Haiyang Shi;Xiaoyi Lu;D. Panda
中科院分区：
文献类型：
--
作者：
Haiyang Shi;Xiaoyi Lu;D. Panda
社区中已经提出了各种基于硬件加速的纠删码（EC）方案，以利用现代数据中心的先进计算能力，例如Intel ISA-L Onload EC编码器和Mellanox InfiniBand Offload EC编码器。这些 EC 编码器可以在设计下一代分布式存储系统中发挥至关重要的作用。不幸的是，对于分布式存储系统研究人员和设计人员来说，不存在一种统一且简单的方法来对这些不同的 EC 编码器的性能进行基准测试、测量和表征。在此背景下，我们提出了一个名为 EC-Bench 的统一基准测试套件，以帮助用户在现代硬件架构上对加载和卸载 EC 编码器进行基准测试。 EC-Bench 提供编码和解码基准以及可调参数支持。可以通过 EC-Bench 报告一组丰富的指标，包括延迟、实际和标准化吞吐量、CPU 利用率和缓存压力。 EC-Bench 的评估表明，与加载编码器相比，硬件优化的卸载编码器（例如 Mellanox-EC）对 CPU 和缓存的要求较低，并且对于大多数配置，高度优化的加载编码器（例如 Intel ISA-L）的性能优于卸载编码器。
Various Erasure Coding (EC) schemes based on hardware accelerations have been proposed in the community to leverage the advanced compute capabilities on modern data centers, such as Intel ISA-L Onload EC coders and Mellanox InfiniBand Offload EC coders. These EC coders can play a vital role in designing next-generation distributed storage systems. Unfortunately, there does not exist a unified and easy way for distributed storage systems researchers and designers to benchmark, measure, and characterize the performance of these different EC coders. In this context, we propose a unified benchmark suite, called EC-Bench, to help the users to benchmark both onload and offload EC coders on modern hardware architectures. EC-Bench provides both encoding and decoding benchmarks with tunable parameter support. A rich set of metrics, including latency, actual and normalized throughput, CPU utilization, and cache pressure, can be reported through EC-Bench. Evaluations with EC-Bench demonstrate that hardware-optimized offload coders (e.g. Mellanox-EC) have lower demands on CPU and cache compared to onload coders, and highly optimized onload coders (e.g., Intel ISA-L) outperform offload coders for most configurations.