An effective online data monitoring and saving strategy for large-scale climate simulations
An effective online data monitoring and saving strategy for large-scale climate simulations
复制标题
大规模气候模拟的有效在线数据监测和保存策略
DOI：
10.1080/16843703.2017.1414112
复制
发表时间：
2019
影响因子：
2.8
通讯作者：
Jian Li
中科院分区：
文献类型：
--
作者：
Xiaochen Xian;Richard Archibald;B. Mayer;Kaibo Liu;Jian Li
大规模气候模拟模型已被开发并广泛用于生成历史数据和研究未来气候情景。这些模拟模型通常需要运行几个月才能了解几十年来全球气候的变化。这种持续时间长的模拟过程产生了大量具有高时间和空间分辨率信息的数据，但如何基于这些连续实时产生的大范围模拟结果有效地监测和记录气候变化仍有待解决。由于将数据写入磁盘的过程很慢，目前的做法是以恒定、缓慢的速度保存模拟结果的快照，尽管数据生成过程运行的速度非常快。考虑到实际存储和存储容量的限制，提出了一种在时间和空间域上有效的在线数据监测和保存策略。我们提出的方法能够在更好地监测气候变化的背景下，从实时模拟产生的原始数据中智能地选择和记录最具信息量的极值。
Abstract Large-scale climate simulation models have been developed and widely used to generate historical data and study future climate scenarios. These simulation models often have to run for a couple of months to understand the changes in the global climate over the course of decades. This long-duration simulation process creates a huge amount of data with both high temporal and spatial resolution information; however, how to effectively monitor and record the climate changes based on these large-scale simulation results that are continuously produced in real time still remains to be resolved. Due to the slow process of writing data to disk, the current practice is to save a snapshot of the simulation results at a constant, slow rate although the data generation process runs at a very high speed. This paper proposes an effective online data monitoring and saving strategy over the temporal and spatial domains with the consideration of practical storage and memory capacity constraints. Our proposed method is able to intelligently select and record the most informative extreme values in the raw data generated from real-time simulations in the context of better monitoring climate changes.