Framework: Software: Collaborative Research: CyberWater--An open and sustainable framework for diverse data and model integration with provenance and access to HPC

框架：软件：协作研究：Cyber​​Water——一个开放且可持续的框架，用于将多种数据和模型集成，并提供 HPC 的来源和访问权限

• 批准号: 1835817
• 负责人: Yao Liang
• 金额: $ 51.42万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1835817&HistoricalAwards=false
• 关键词: Framework; Software; Collaborative; Research; CyberWater

This project addresses a high priority need for water research communities: interoperability among a wide variety of data sources and models, and integration of different computational models into water research communities. The project will develop an open and sustainable software framework enabling integration of hydrologic data and models for interdisciplinary teamwork and discovery. The models and datasets cover fields such as hydrology, biology, environmental engineering and climate. The project also addresses one of the key issues for extreme-scale computing: scalable file systems. The collaboration draws upon computing, modeling, and hydrology expertise at six institutions: University of Pittsburgh, University of Iowa, Ball State University, North Carolina State University, Indiana University, and the Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI). The project develops CyberWater, a community-driven software framework that integrates a wide range of models and datasets across disparate temporal and spatial scales. The CyberWater framework allows scientists to bypass challenges associated with model and dataset complexity. The project designs a model agent tool enabling users to generate model agents for common model types without coding, and integrates multiple existing software codes/elements that provide for broad-scale use. To develop such a diverse modeling framework, the project brings together hydrologists, climate experts, meteorologists, computer scientists and cyberinfrastructure experts. The project builds upon an existing prototype developed by the lead investigator; basic elements for the system were developed, consisting of plugged-in models and data sources with corresponding agents and a workflow engine allowing user workflow control. The prototype was successfully demonstrated for two models, making use of datasets plugged in from NASA, USGS and CUAHSI. For the current project, new models and datasets are added to the framework; the ability to use high performance computing resources is also incorporated. The team will use the CUAHSI HydroShare System to distribute CyberWater software and its associate model agents, including instructions on how to establish a local CyberWater environment, models and model agents. The project will enable substantial scientific advances for water related issues, and the solution can be applied to other research disciplines. This award by the Office of Advanced Cyberinfrastructure is jointly supported by the NSF Directorate for Geosciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目解决了水研究界的高度优先需求：各种数据源和模型之间的互操作性，以及将不同的计算模型集成到水研究界。 该项目将开发一个开放和可持续的软件框架，使水文数据和模型的整合，跨学科的团队合作和发现。 这些模型和数据集涵盖水文学、生物学、环境工程和气候等领域。 该项目还解决了极端规模计算的关键问题之一：可伸缩文件系统。 这项合作利用了六个机构的计算、建模和水文专业知识：匹兹堡大学、爱荷华州大学、鲍尔州立大学、北卡罗来纳州州立大学、印第安纳州大学和水文科学促进大学联盟。（CUAHSI）。 该项目开发了CyberWater，这是一个社区驱动的软件框架，集成了跨不同时空尺度的各种模型和数据集。CyberWater框架允许科学家绕过与模型和数据集复杂性相关的挑战。 该项目设计了一个模型代理工具，使用户能够生成通用模型类型的模型代理，而无需编码，并集成了多个现有的软件代码/元素，提供广泛的使用。 为了开发这样一个多样化的建模框架，该项目汇集了水文学家，气候专家，气象学家，计算机科学家和网络基础设施专家。 该项目以首席调查员开发的现有原型为基础;开发了该系统的基本要素，包括插入式模型和数据源，以及相应的代理和允许用户控制工作流程的工作流程引擎。 该原型成功地为两个模型进行了演示，利用了NASA，USGS和CUAHSI的数据集。 对于当前的项目，新的模型和数据集被添加到框架中;使用高性能计算资源的能力也被纳入其中。 该团队将使用CUAHSI HydroShare系统分发CyberWater软件及其相关模型代理，包括如何建立本地CyberWater环境、模型和模型代理的说明。该项目将使与水有关的问题取得实质性的科学进展，该解决方案可应用于其他研究学科。该奖项由高级网络基础设施办公室颁发，并得到NSF地球科学理事会的共同支持。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Accelerating complex modeling workflows in CyberWater using on-demand HPC/Cloud resources

使用按需 HPC/云资源加速 Cyber​​Water 中的复杂建模工作流程

• DOI: 10.1109/escience51609.2021.00030
• 发表时间: 2021
• 期刊: The 17th IEEE International Conference on eScience
• 作者: Li, Feng;Chen, Ranran;Fu, Yuankun;Song, Fengguang;Liang, Yao;Ranawaka, Isuru;Pamidighantam, Sudhakar;Luna, Daniel;Liang, Xu
• 通讯作者: Liang, Xu

CyberWater: An Open Framework for Data and Model Integration in Water Science and Engineering

Cyber​​Water：水科学与工程中数据和模型集成的开放框架

• DOI: 10.1145/3511808.3557186
• 发表时间: 2022
• 期刊: Proceedings of the 31st ACM Int’l Conference on Information and Knowledge Management (CIKM’22
• 作者: Chen, Ranran;Luna, Daniel;Li, Feng;Young, Ryan;Bieger, Drew;Song, Fengguang;Pamidighantam, Sudhakar;Liang, Yao;Liang, Xu
• 通讯作者: Liang, Xu

X-composer: enabling cross-environments in-situ workflows between HPC and cloud

X-composer：支持 HPC 和云之间的跨环境现场工作流程

• DOI: 10.1145/3468267.3470621
• 发表时间: 2021
• 期刊: Proceedings of the Platform for Advanced Scientific Computing Conference
• 作者: Li, Feng;Wang, Dali;Yan, Feng;Song, Fengguang
• 通讯作者: Song, Fengguang

Open data and model integration through generic model agent toolkit in CyberWater framework

• DOI: 10.1016/j.envsoft.2022.105384
• 发表时间: 2022-03
• 期刊: Environ. Model. Softw.
• 作者: Ranran Chen;Daniel Luna;Yuan Cao;Yao Liang;Xu Liang