Zperf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression
Zperf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression
复制标题
Zperf：科学有损压缩性能建模和外推的统计灰盒方法
DOI：
10.1109/tc.2023.3257517
复制
发表时间：
2023
影响因子：
3.7
通讯作者：
He, Xubin
中科院分区：
文献类型：
--
作者：
Wang, Jinzhen;Chen, Qi;Liu, Tong;Liu, Qing;He, Xubin
随着基于仿真的科学发现在高性能计算系统上的扩展，计算和I/O之间的差距越来越大，迫使领域科学家只能将少量的仿真数据保存到持久存储中。这可能导致数据分析所需的基本物理场的丢失。虽然误差受限有损压缩在弥合计算和I/O之间的差距方面取得了巨大进展，但对压缩性能缺乏了解仍然是其广泛采用的关键障碍。在这项工作中，我们提出了zPerf，一个统计灰盒性能建模方法的科学有损压缩。我们的贡献有三个方面：1）基于对数据特征和核心压缩指标的深入理解和统计建模，我们开发了zPerf来评估有损压缩技术的性能; 2）我们使用两个案例研究来演示zPerf的详细实现，其中我们推导了两个主要有损压缩器SZ和ZFP的性能建模; 3）我们评估了zPerf在不同领域的真实数据集上的有效性。基于评估，我们证明了zPerf性能模型的有效性; 4）我们进一步讨论了三个案例研究，其中zPerf被应用于外推SZ和ZFP与替代编码方案以及ZFP与替代变换方案的压缩比。通过案例研究，我们展示了zPerf探索有损压缩设计空间的潜力，这在文献中几乎没有研究过。
With the scaling up of simulation-based scientific discovery on high-performance computing systems, the disparity between compute and I/O has increased, forcing domain scientists to save only a small amount of simulation data to persistent storage. This can result in the loss of essential physics fields that are needed for data analysis. While error-bounded lossy compression has made tremendous progress in bridging the gap between compute and I/O, the lack of understanding of compression performance remains a key hurdle to its wide adoption. In this work, we present zPerf, a statistical gray-box performance modeling approach for scientific lossy compression. Our contributions are threefold: 1) We develop zPerf to estimate the performance of lossy compression techniques, based on in-depth understanding and statistical modeling for data features and core compression metrics; 2) We demonstrate the in-detailed implementation of zPerf using two case studies, where we derive the performance modeling for SZ and ZFP, two leading lossy compressors; 3) We evaluate the effectiveness of zPerf on real-world datasets across various domains. Based on the evaluation, we demonstrate the efficacy of the zPerf performance model; 4) We further discuss three case studies where zPerf is applied to extrapolate the compression ratio of SZ and ZFP with alternative encoding schemes as well as ZFP with an alternative transform scheme. Through the case studies, we demonstrate the potential of zPerf for exploring the design space of lossy compression, which has hardly been studied in the literature.