Collaborative Research: Frameworks: Building a Collaboration Infrastructure: CyberWater2 -- A Sustainable Data/Model Integration Framework

包括水文、生物、环境、大气、海洋和其他地球科学在内的气候变化所引起的自然灾害，如飓风和严重干旱引起的沿海和内陆洪水及其相关野火，以前所未有的频率发生。这些危害不仅对我们的环境造成了严重的破坏，需要付出巨大的努力来恢复，而且还使人们付出了生命的代价。为了减轻这些潜在的灾害，现在是解决与之相关的基本和大规模科学问题的关键时刻，这些问题影响着我们所居住的地球系统的健康、恢复力和可持续性。这些问题是复杂和多学科的，来自不同领域的研究人员和实践者必须共同努力找到解决方案。就其性质而言，地球系统模型由组成部分模型组成——从陆地表面到河流、沿海地区、海洋、海冰和大气，其中每个组成部分模型彼此耦合。随着科学的进步，一个组件模型或它的子系统可能不得不被替换，因为有了新的理解，或者因为必须探索和测试不同的观点，以获得不同组合的可信度，从而在不同的地点找到最可信的预测。这样的任务通常需要大量的努力和时间，并可能成为瓶颈。该项目旨在开发一种新的开源网络基础设施框架Cyberwater2，其中模型耦合从当前的“代码耦合”方法转变为新的“信息耦合”方法，并且可以在不编写粘合代码的情况下进行配置。这最大限度地减少了访问和修改每个参与模型的原始代码的需要，并消除了大规模跨机构合作和跨学科和地理边界的科学研究的主要障碍。CyberWater2是为各种研究团体设计的，包括水、气候、海岸、工程等。在我们的框架下，研究人员可以将他们的协作精力投入到问题解决和新领域的探索中，同时使用CyberWater2有效地实现跨平台的双向开放模型耦合、模型参数校准、数据同化、测试/验证/比较等。该项目的目标是通过开发网络基础设施，使复杂问题的大规模协作更容易进行，并有效、准确和深入地解决这些问题。cyberwaterer2，它(1)显著消除了跨异构计算平台、学科和组织的双向耦合的“粘合”编码；(2)自动化复杂的模型校准，简化适用于各种模型的数据同化过程；(3)支持基于任务和原位的混合工作流，大大提高了异构平台双向耦合的效率；(4)除独立系统外，为用户提供“数码水二号”服务器和web服务架构；(5)通过自动调整数据代理以适应提供商对外部数据源所做的更改（例如，API接口），实现来自不同来源的可持续数据访问；(6)实现自动化资源规划，并根据需要为高性能计算(HPC)/云访问提供智能站点推荐，以最大限度地提高用户利益。该项目由计算机与信息科学与工程理事会的先进网络基础设施办公室和地球科学理事会的地球科学部提供支持。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Natural hazards, such as coastal and inland flooding caused by Hurricanes and severe drought and its associated wildfire, have been occurring with unprecedented frequency, induced by climate changes that encompass hydrological, biological, environmental, atmospheric, ocean, and other geosciences. Such hazards have caused not only profound damages to our environment and required tremendous efforts to recover, but also cost people's lives. To mitigate these potential disasters, it is a critical time to tackle their associated scientific questions both fundamental and large-scale that impact on the health, resilience, and sustainability of the Earth system we live in. The problems are complex and multidisciplinary, and researchers and practitioners from diverse fields must work together to find solutions. By its nature, Earth system models are comprised of component models – from land surface, to rivers, coastal regions, ocean, sea ice, and atmosphere, where each component model is coupled with one another. As science advances, a component model or its subsystems may have to be replaced because of new understanding, or because different perspectives must be explored and tested for the credence of different combinations to find the most credible predictions for different conditions at different locations. Such tasks often require substantial efforts and time and can become a bottleneck. This project is aimed at developing a new open-source cyberinfrastructure framework, Cyberwater2, in which model coupling is shifted from the current "code-coupling" approach to a new "information coupling" approach, and can be configured without writing glue code. This minimizes the need to access and modify each participating model's original code, and removes a major obstacle for large-scale cross-institutional collaborations and scientific investigations across disciplines and geographic boundaries. CyberWater2 is designed for diverse research communities including water, climate, coastal, engineering, and beyond. With our framework, researchers can devote their collaborative energy on problem solving and exploration of new frontiers, while using CyberWater2 to effectively achieve two-way open model couplings across platforms, model parameter calibration, data assimilation, testing/validations/comparisons, etc.The goal of this project is to make it easier to conduct large scale collaboration on complex problems and solve them efficiently, accurately and in-depth by developing a cyberinfrastructure, CyberWatyer2, that (1) significantly eliminates "glue" coding for two-way couplings across heterogeneous computing platforms, disciplines, and organizations; (2) automates complex model calibration and facilitates data assimilation processes applicable to various models; (3) supports task-based and in-situ hybrid workflow for greatly improved efficiency on two-way coupling across heterogeneous platforms; (4) provides a CyberWater2 server and web service framework for users in addition to the standalone systems; (5) enables sustainable data access from diverse sources by automatically adapting data agents to the changes (e.g., API interfaces) made to external data sources by providers; and (6) enables automated resource planning with intelligent site recommendation for High Performance Computing (HPC)/Cloud access on demand to maximize users' benefits.This project is supported by the Office of Advanced Cyberinfrastructure in the Directorate for Computer & Information Science & Engineering and the Division of Earth Sciences in the Directorate of Geosciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.