A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)

A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)
复制标题

耦合模型比对项目第 6 阶段 (CMIP6) 社区地球系统模型(2.0 版)的新端到端工作流程

DOI:
--
复制
发表时间:
2020
期刊:
影响因子:
--
通讯作者:
M. Vertenstein
M. Vertenstein
中科院分区:
--
文献类型:
--
作者:
S. Mickelson;A. Bertini;G. Strand;Kevin Paul;E. Nienhouse;J. Dennis;M. Vertenstein

文献摘要

参考文献

被引文献

相似文献

抽象。每一代耦合模式相互比较项目的复杂性都在增加。 与上一代阶段3相比,第5阶段的工作在执行的实验数量和请求的变量数量上都有了显著增加。 数据量的大幅增加给包括国家大气研究中心在内的几个中心的资源带来了压力。 在第5阶段,我们错过了几个最后期限,我们努力将数据提供给社区进行分析。 在为当前一代(第6阶段)做准备时,我们检查了工作流程中的弱点,并使用新的软件工具解决了性能问题。 通过这项投资,我们能够向社区发布大约565 TB的压缩数据,另有30 TB尚未发布。 与我们在上一代中产生的165 TB未压缩数据量相比,我们能够提供6倍的数据量,并且我们在三分之一的时间内完成了这一任务。 这为我们提供了大约18倍的加速。 虽然本文讨论了我们对耦合模型相互比较项目第6阶段(CMIP 6)的工作流程所做的改进,但我们希望鼓励其他中心评估和投资自己的工作流程,以便在这些类型的建模活动中取得成功。
Abstract. The complexity of each Coupled Model Intercomparison Project grows with every new generation. The Phase 5 effort saw a dramatic increase in the number of experiments that were performed and the number of variables that were requested compared to its previous generation, Phase 3. The large increase in data volume stressed the resources of several centers including at the National Center for Atmospheric Research. During Phase 5, we missed several deadlines and we struggled to get the data out to the community for analysis. In preparation for the current generation, Phase 6, we examined the weaknesses in our workflow and addressed the performance issues with new software tools. Through this investment, we were able to publish approximately 565 TB of compressed data to the community, with another 30 TB yet to be published. When compared to the volumes we produced in the previous generation, 165 TB of uncompressed data, we were able to provide 6 times the amount of data and we accomplish this within one-third of the time. This provided us with an approximate 18 times faster speedup. While this paper discusses the improvements we have made to our own workflow for the Coupled Model Intercomparison Project Phase 6 (CMIP6), we hope to encourage other centers to evaluate and invest in their own workflows in order to be successful in these types of modeling campaigns.
DOI: 10.5194/gmd-2018-82
发表时间: 2018
期刊: --
影响因子: --
作者:
Smith D
通讯作者: Smith D