Comprehensive Assessment of Models and Events Using Library Tools (CAMEL) Framework: Time Series Comparisons
Comprehensive Assessment of Models and Events Using Library Tools (CAMEL) Framework: Time Series Comparisons
复制标题
使用库工具 (CAMEL) 框架综合评估模型和事件：时间序列比较
DOI：
10.1029/2018sw002043
复制
发表时间：
2019
期刊：
影响因子：
3.7
通讯作者：
P. MacNeice
中科院分区：
文献类型：
--
作者：
L. Rastätter;C. Wiegand;R. Mullinix;P. MacNeice
使用库工具对模型和事件进行综合评估 (CAMEL) 框架利用现有的社区协调建模中心服务：生成模型时间序列输出的按需运行后处理工具，以及使用空间物理档案搜索和提取元数据描述模拟运行的新社区协调建模中心元数据注册表。新的 CAMEL 可视化工具将建模时间序列与观测数据进行比较，并计算一系列技能得分，例如预测效率、均方根误差和对称符号百分比偏差。用于技能计算的模型数据对是考虑用户选择的观察时间和最近模型输出之间的最大差异而获得的。该系统使用交互式可视化呈现所选的所有位置和时间段的可用数据，允许用户沿着轨迹缩放、平移和选取数据值。报告每个选定事件的技能分数，或汇总所有参与模型运行的所有事件的技能分数。分别报告所有位置（卫星或空间站）以及每个位置的分数。我们正在借鉴过去对 GEM2008、GEM-CEDAR 电动力学热层电离层和 SWPC 操作空间天气模型挑战的磁层和电离层模型输出的模型数据比较的经验。 CAMEL 可视化工具通过三项验证研究进行了演示：(a) Wang-Sheeley-Arge 日光层模拟与 OMNI 太阳风数据进行比较，(b) 磁力计观测到的多个磁层和电离层电动力学模型的地面磁扰动，以及 (c) 与辐射带风暴探测器氦氧质子电子仪器测量相比的多个环电流模拟的电子通量，在不同能量范围内进行积分。
The Comprehensive Assessment of Models and Events using Library Tools (CAMEL) framework leverages existing Community Coordinated Modeling Center services: Run‐on‐Request postprocessing tools that generate model time series outputs and the new Community Coordinated Modeling Center Metadata Registry that describes simulation runs using Space Physics Archive Search and Extract metadata. The new CAMEL visualization tool compares the modeled time series with observational data and computes a suite of skill scores such as Prediction Efficiency, Root‐Mean‐Square Error, and Symmetric Signed Percentage Bias. Model‐data pairs used for skill calculations are obtained considering a user‐selected maximum difference between the time of observation and the nearest model output. The system renders available data for all locations and time periods selected using interactive visualizations that allow the user to zoom, pan, and pick data values along traces. Skill scores are reported for each selected event or aggregated over all events for all participating model runs. Separately, scores are reported for all locations (satellites or stations) and for each location individually. We are building on past experiences with model‐data comparisons of magnetosphere and ionosphere model outputs from GEM2008, GEM‐CEDAR Electrodynamics Thermosphere Ionosphere, and the SWPC Operational Space Weather Model challenges. The CAMEL visualization tool is demonstrated using three validation studies: (a) Wang‐Sheeley‐Arge heliosphere simulations compared against OMNI solar wind data, (b) ground magnetic perturbations from several magnetosphere and ionosphere electrodynamics models as observed by magnetometers, and (c) electron fluxes from several ring current simulations compared to Radiation Belt Storm Probes Helium Oxygen Proton Electron instrument measurements, integrated over different energy ranges.
DOI：
10.1002/2017sw001669
发表时间：
2018-01-01
影响因子：
3.7
作者：
Morley, S. K.;Brito, T. V.;Welling, D. T.
通讯作者：
Welling, D. T.