Collaborative Research: Frameworks: Building a Collaboration Infrastructure: CyberWater2 -- A Sustainable Data/Model Integration Framework

由水文、生物、环境、大气、海洋和其他地球科学领域的气候变化引发的自然灾害，例如飓风、严重干旱及其相关野火引起的沿海和内陆洪水，以前所未有的频率发生。这些危害不仅对我们的环境造成了严重破坏，需要付出巨大的努力来恢复，而且还夺去了人们的生命。为了减轻这些潜在的灾难，现在是解决影响我们生活的地球系统的健康、复原力和可持续性的相关基础性和大规模科学问题的关键时刻。这些问题是复杂的、多学科的，来自不同领域的研究人员和从业者必须共同努力寻找解决方案。从本质上讲，地球系统模型由多个组件模型组成——从陆地表面到河流、沿海地区、海洋、海冰和大气，其中每个组件模型都是相互耦合的。随着科学的进步，由于新的理解，或者因为必须探索和测试不同的观点以验证不同组合的可信度，以便为不同地点的不同条件找到最可信的预测，组件模型或其子系统可能必须被替换。此类任务通常需要大量的努力和时间，并且可能成为瓶颈。该项目旨在开发一个新的开源网络基础设施框架Cyber​​water2，其中模型耦合从当前的“代码耦合”方式转变为新的“信息耦合”方式，并且无需编写胶水代码即可配置。这最大限度地减少了访问和修改每个参与模型的原始代码的需要，并消除了大规模跨机构合作和跨学科和地理边界的科学研究的主要障碍。 Cyber​​Water2 专为水、气候、沿海、工程等领域的不同研究领域而设计。借助我们的框架，研究人员可以将协作精力投入到问题解决和新领域探索上，同时使用CyberWater2有效实现跨平台的双向开放模型耦合、模型参数校准、数据同化、测试/验证/比较等。该项目的目标是通过开发网络基础设施CyberWatyer2，使复杂问题更容易进行大规模协作，并高效、准确和深入地解决它们，(1)显着消除用于跨异构计算平台、学科和组织的双向耦合的“粘合”编码； （2）自动化复杂模型校准并促进适用于各种模型的数据同化过程； （3）支持基于任务的原位混合工作流程，大大提高跨异构平台双向耦合的效率； (4) 除独立系统外，还为用户提供Cyber​​Water2服务器和Web服务框架； (5) 通过自动使数据代理适应提供商对外部数据源所做的更改（例如 API 接口），实现来自不同来源的可持续数据访问； (6) 通过按需高性能计算 (HPC)/云访问的智能站点推荐实现自动化资源规划，以最大限度地提高用户的利益。该项目得到了计算机与信息科学与工程局高级网络基础设施办公室和地球科学局地球科学部的支持。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

Natural hazards, such as coastal and inland flooding caused by Hurricanes and severe drought and its associated wildfire, have been occurring with unprecedented frequency, induced by climate changes that encompass hydrological, biological, environmental, atmospheric, ocean, and other geosciences. Such hazards have caused not only profound damages to our environment and required tremendous efforts to recover, but also cost people's lives. To mitigate these potential disasters, it is a critical time to tackle their associated scientific questions both fundamental and large-scale that impact on the health, resilience, and sustainability of the Earth system we live in. The problems are complex and multidisciplinary, and researchers and practitioners from diverse fields must work together to find solutions. By its nature, Earth system models are comprised of component models – from land surface, to rivers, coastal regions, ocean, sea ice, and atmosphere, where each component model is coupled with one another. As science advances, a component model or its subsystems may have to be replaced because of new understanding, or because different perspectives must be explored and tested for the credence of different combinations to find the most credible predictions for different conditions at different locations. Such tasks often require substantial efforts and time and can become a bottleneck. This project is aimed at developing a new open-source cyberinfrastructure framework, Cyberwater2, in which model coupling is shifted from the current "code-coupling" approach to a new "information coupling" approach, and can be configured without writing glue code. This minimizes the need to access and modify each participating model's original code, and removes a major obstacle for large-scale cross-institutional collaborations and scientific investigations across disciplines and geographic boundaries. CyberWater2 is designed for diverse research communities including water, climate, coastal, engineering, and beyond. With our framework, researchers can devote their collaborative energy on problem solving and exploration of new frontiers, while using CyberWater2 to effectively achieve two-way open model couplings across platforms, model parameter calibration, data assimilation, testing/validations/comparisons, etc.The goal of this project is to make it easier to conduct large scale collaboration on complex problems and solve them efficiently, accurately and in-depth by developing a cyberinfrastructure, CyberWatyer2, that (1) significantly eliminates "glue" coding for two-way couplings across heterogeneous computing platforms, disciplines, and organizations; (2) automates complex model calibration and facilitates data assimilation processes applicable to various models; (3) supports task-based and in-situ hybrid workflow for greatly improved efficiency on two-way coupling across heterogeneous platforms; (4) provides a CyberWater2 server and web service framework for users in addition to the standalone systems; (5) enables sustainable data access from diverse sources by automatically adapting data agents to the changes (e.g., API interfaces) made to external data sources by providers; and (6) enables automated resource planning with intelligent site recommendation for High Performance Computing (HPC)/Cloud access on demand to maximize users' benefits.This project is supported by the Office of Advanced Cyberinfrastructure in the Directorate for Computer & Information Science & Engineering and the Division of Earth Sciences in the Directorate of Geosciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.