Toward a Multi-method Approach: Lossy Data Compression for Climate Simulation Data
Toward a Multi-method Approach: Lossy Data Compression for Climate Simulation Data
复制标题
迈向多方法：气候模拟数据的有损数据压缩
DOI：
--
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
J. Clyne
中科院分区：
文献类型：
--
作者：
A. Baker;Haiying Xu;D. Hammerling;Shaomeng Li;J. Clyne
地球系统模型(ESM)的模拟越来越受到它们所产生的数据量的限制，而不是受计算资源的限制。对模型输出使用有损数据压缩可以降低存储成本和数据传输开销，但必须注意确保科学结果不受影响。考虑到ESM产生的数据的多样性，选择适当的压缩算法和参数并不是一件容易的事，需要了解数据的属性和所选压缩方法的属性。在这里，我们讨论了两种不同的有损压缩方法的性质，在众所周知的ESM的背景下，展示了每种方法的不同优点，以促进气候模式输出压缩的自动多方法方法的发展。
Earth System Model (ESM) simulations are increasingly constrained by the amount of data that they generate rather than by computational resources. The use of lossy data compression on model output can reduce storage costs and data transmission overheads, but care must be taken to ensure that science results are not impacted. Choosing appropriate compression algorithms and parameters is not trivial given the diversity of data produced by ESMs and requires an understanding of both the attributes of the data and the properties of the chosen compression methods. Here we discuss the properties of two distinct approaches for lossy compression in the context of a well-known ESM, demonstrating the different strengths of each, to motivate the development of an automated multi-method approach for compression of climate model output.