Collaborative Research: SI2-SSI: Cyberinfrastructure for Advancing Hydrologic Knowledge through Collaborative Integration of Data Science, Modeling and Analysis

合作研究：SI2-SSI：通过数据科学、建模和分析的协作集成推进水文知识的网络基础设施

• 批准号: 1664061
• 负责人: David Tarboton
• 金额: $ 276万
• 依托单位: Utah State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-10-01 至 2022-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1664061&HistoricalAwards=false
• 关键词: Collaborative; Research; SI2; SSI; Cyberinfrastructure

Researchers across the country and around the world expend tremendous resources to gather and analyze vast stores of hydrologic data and populate a myriad of models to better understand hydrologic phenomena and find solutions to vexing water problems. Each of those researchers has limited money, time, computational capacity, data storage, and ability to put that data to productive use. What if they could combine their efforts to make collaboration easier? What if those collected data sets and processed model outputs could be used collaboratively to help advance hydrologic understanding beyond their original purpose? HydroShare is a system to advance hydrologic science by enabling the scientific community to more easily and freely share products resulting from their research, not just the scientific publication summarizing a study, but also the data and models used to create the scientific publication. HydroShare supports the sharing and publication of hydrologic data and models. This capability is necessary for community model development, execution, and evaluation and to improve reproducibility and community trust in scientific findings through transparency. As a platform for collaboration and running models on advanced computational infrastructure, HydroShare enhances the capability for data intensive research in hydrology and other aligned sciences. HydroShare is designed to help researchers easily meet the sharing requirements of data management plans while at the same time providing value added functionality that makes metadata capture more effective and helps researchers improve their work productivity. This project will extend the capabilities of the HydroShare cyberinfrastructure to enhance support for scientific methods, advance the social capabilities of HydroShare to enable improved collaborative research, integrate with 3rd party consumer data storage systems to provide more flexible and sustainable data storage. and establish an application testing environment to empower researchers to develop their own computer programs to act on and work with data in HydroShare. Empowering HydroShare users with the ability to rapidly develop web application programs opens the door to unforeseen, innovative combinations of data and models. WRF-Hydro, the framework for the NOAA National Water Model, will be used as a use case for collaboration on model development. Since WRF-Hydro is used by NOAA as part of the National Water Model (NWM), this collaboration opens possibilities for transfer of research to operations. Collectively, this functionality will provide a computing framework for transforming the practice of broad science communities to leverage advances in data science and computation and accelerate discovery.HydroShare is a system for sharing hydrologic data and models aimed at giving hydrologists the cyberinfrastructure needed to manage data, innovate and collaborate in research to solve water problems. It addresses the challenges of sharing data and hydrologic models to support collaboration and reproducible hydrologic science through the publication of hydrologic data and models. With HydroShare users can: (1) share data and models with colleagues; (2) manage who has access to shared content; (3) share, access, visualize and manipulate a broad set of hydrologic data types and models; (4) use the web services interface to program automated and client access; (5) publish data and models to meet the requirements of research project data management plans; (6) discover and access data and models published by others; and (7) use web apps to visualize, analyze, and run models on data. This project will extend the capabilities of HydroShare to: (1) enhance support for scientific methods enabling systematic data and model analysis and hypothesis testing; (2) advance the social capabilities of HydroShare to enable improved collaborative research; (3) integrate with 3rd party consumer data storage systems to provide more flexible and sustainable data storage; and (4) establish an application testing environment to empower researchers to develop their own computer programs to act on and work with data in HydroShare. Under development since 2012 and first released in 2014, HydroShare supports the sharing and publication of hydrologic data and models. This capability is necessary for community model development, execution, and evaluation. As a platform for collaboration and cloud based computation on network servers remote from the user, HydroShare enhances the capability for data intensive research in hydrology and other aligned sciences. HydroShare is innovative from a computer science and CI perspective in the way computation and data sharing are framed as a network computing platform that integrates data storage, organization, discovery, and programmable actions through web applications (web apps). Support for these three key elements of computation allows researchers to easily employ services beyond the desktop to make data storage and manipulation more reliable and scalable, while improving ability to collaborate and reproduce results. The generation of new understanding, through integration of information from multiple sources and reuse and collaborative enrichment of research data and models, will be enhanced. Structured and systematic model process intercomparisons and alternative hypothesis testing will be enabled, bringing, through user friendly CI, the latest thinking in advancing hydrologic modeling to a broad community of earth science researchers, thereby transforming research practices and the knowledge generated from this research. Interoperability with consumer cloud storage will greatly ease entry of content into HydroShare and support its sustainability. This meshing of the rigorous metadata model of HydroShare with consumer file sharing will enhance reproducibility as well as provide an innovative mechanism for sharing and collaboration. Empowering HydroShare users with the ability to rapidly develop web apps opens the door to unforeseen, innovative combinations of data and models. WRF- Hydro will be used as a use case for collaboration on model development. WRF-Hydro provides a reach-based high resolution representation of hydrologic processes, and offers the potential to bring together scientists working at scales from research catchments on the order of 1 to 100s of square kilometers as well as those working at regional to continental scales and cut across disciplines from environmental engineering to aquatic ecologists. Since WRF-Hydro is used by NOAA as part of the National Water Model (NWM), this collaboration opens possibilities for transfer of research to operations. This project will adapt current best practices in CI for interoperability and extensibility to serve this multidisciplinary community of scientists. HydroShare has already had a broader impact, with documented rapid growth in use and uptake by other projects including in EarthCube. It will become sustainable community CI through operation as part of the Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) Water Data Center (WDC) facility. The use of WRF- Hydro/NWM, as a driving use case, will advance CI for community based model improvement. Through the Summer Young Innovators Program at the National Water Center (NWC), supported by the National Weather Service (NWS) and operated by CUAHSI, a pathway already exists to translate research findings to the operational needs of federal agencies participating in the NWC. HydroShare already touches a broad and diverse community, with user base including Native American tribes, hydrologic science students, and faculty researchers across the U.S. This proposal builds on the success of HydroShare to extend its capabilities and broaden model hypothesis testing, collaborative data sharing, and open app development across earth science research and education.

全国各地的研究人员花费了巨大的资源来收集和分析大量的水文数据存储，并填充了无数模型，以更好地了解水文现象，并找到解决水问题的解决方案。这些研究人员中的每一个都有有限的资金，时间，计算能力，数据存储以及将这些数据投入生产性使用的能力。如果他们可以结合努力使协作更轻松怎么办？如果这些收集的数据集和经过处理的模型输出可以合作使用以帮助将水文理解推向其最初的目的，该怎么办？ Hydroshare是一种通过使科学界能够更轻松，更自由地共享其研究产生的产品来推进水文科学的系统，而不仅仅是总结了一项研究的科学出版物，还可以通过研究来创建科学出版物。 Hydroshare支持水文数据和模型的共享和发布。这种能力对于社区模型开发，执行和评估是必要的，并且通过透明度提高了科学发现的可重复性和社区信任。作为用于高级计算基础架构的协作和运行模型的平台，HydroShare增强了水文学和其他对齐科学的数据密集型研究的能力。 HydroShare旨在帮助研究人员轻松满足数据管理计划的共享要求，同时提供增值功能，从而使元数据捕获更有效，并帮助研究人员提高其工作效率。该项目将扩大水力发生网络基础架构的能力，以增强对科学方法的支持，提高水力学的社交能力，以促进改进的协作研究，并与第三方消费者数据存储系统集成，以提供更灵活和可持续的数据存储。并建立一个应用程序测试环境，以使研究人员能够开发自己的计算机程序，以在Hydroshare中采取行动并使用数据。授权水力发生用户能够快速开发Web应用程序的能力打开了不可预见的数据和模型组合的大门。 NOAA国家水模型的框架WRF-HYDRO将被用作模型开发协作的用例。由于NOAA将WRF-HYDRO用作国家水模型（NWM）的一部分，因此这种合作为将研究转移到运营开辟了可能性。总的来说，该功能将提供一个计算框架，用于改变广泛的科学社区的实践，以利用数据科学和计算的进步，并加速发现发现。氢化物是一种共享水文数据和模型的系统，旨在为水文学家提供网络基础设施，以管理数据，创新和协作解决水问题。它解决了共享数据和水文模型的挑战，以通过出版水文数据和模型来支持协作和可重复的水文科学。借助Hydroshare用户可以：（1）与同事共享数据和模型； （2）管理谁可以访问共享内容； （3）共享，访问，可视化和操纵一系列水文数据类型和模型； （4）使用Web服务接口来编程自动化和客户端访问； （5）发布数据和模型，以满足研究项目数据管理计划的要求； （6）发现并访问其他人发表的数据和模型； （7）使用Web应用程序可视化，分析和运行数据模型。该项目将将水果的能力扩展到：（1）增强对科学方法的支持，从而实现系统数据，模型分析以及假设测试； （2）提高水力学的社会能力，以提高协作研究； （3）与第三方消费者数据存储系统集成，以提供更灵活和可持续的数据存储； （4）建立一个应用程序测试环境，以使研究人员能够开发自己的计算机程序，以在Hydroshare中采取行动和处理。自2012年以来开发，并于2014年首次发行，Hardroshare支持了水文数据和模型的共享和发布。这种功能对于社区模型开发，执行和评估是必需的。作为对远离用户的网络服务器进行协作和基于云的计算的平台，HydroShare增强了在水文学和其他对齐科学方面的数据密集型研究的能力。从计算机科学和CI的角度来看，Hydroshare是一种创新的，以计算和数据共享为网络计算平台，该平台通过Web应用程序（Web Apps）整合数据存储，组织，发现和可编程操作。对这三个关键计算要素的支持使研究人员可以轻松地使用桌面以外的服务来使数据存储和操纵更加可靠，可扩展，同时提高协作和重现结果的能力。通过从多个来源的信息集成以及重复使用和协作的研究数据和模型的协作丰富来产生新的理解。结构化和系统的模型过程对比子和替代假设测试将通过用户友好的CI启用，这是将水文建模推进到广泛的地球科学研究人员社区的最新思想，从而改变了研究实践和这项研究所产生的知识。与消费者云存储的互操作性将大大简化内容进入水力发电并支持其可持续性。与消费者文件共享的严格元数据模型的这种网格将增强可重复性，并提供共享和协作的创新机制。赋予水力发生用户能够快速开发Web应用程序的能力打开了不可预见的数据和模型的创新组合。 WRF-Hydro将用作模型开发协作的用例。 WRF-HYDRO提供了基于触及的水文过程的高分辨率表示，并提供了将科学家从研究集水区中的科学家组合在一起，从1到100平方公里的阶，以及在区域尺度上工作的科学家，并削减了从环境工程生态学的跨学科。由于NOAA将WRF-HYDRO用作国家水模型（NWM）的一部分，因此这种合作为将研究转移到运营开辟了可能性。该项目将适应CI中当前的最佳实践，以互操作性和可扩展性，以服务于这个多学科的科学家社区。 Hydroshare已经产生了更广泛的影响，其中包括EarthCube在内的其他项目的使用快速增长和吸收。作为水文科学公司（Cuahsi）水数据中心（WDC）设施的大学联盟的一部分，它将通过运营成为可持续的社区CI。 WRF-Hydro/NWM作为驾驶用例的使用将促进CI的基于社区的模型改进。在国家供水中心（NWC）的夏季，在国家气象局（NWS）并由库阿西运营的夏季年轻创新者计划中，已经存在一条途径，可以将研究发现转化为参与NWC的联邦机构的运营需求。 Hydroshare已经触及了一个广阔而多样的社区，包括美国原住民部落，水文科学专业的学生以及美国各地的教职员工研究人员，这项提案以Hydroshare的成功扩展其能力并扩大模型假设测试，协作数据共享以及在地球科学研究和教育中开放应用程序开发。

项目成果

OpenCLC: An open-source software tool for similarity assessment of linear hydrographic features

OpenCLC：用于线性水文特征相似性评估的开源软件工具

• DOI: 10.1016/j.softx.2020.100401
• 发表时间: 2020
• 期刊: SoftwareX
• 影响因子: 3.4
• 作者: Li, Ting;Stanislawski, Lawrence V.;Brockmeyer, Tyler;Wang, Shaowen;Shavers, Ethan
• 通讯作者: Shavers, Ethan

Water Data Explorer: An Open-Source Web Application and Python Library for Water Resources Data Discovery

Water Data Explorer：用于水资源数据发现的开源 Web 应用程序和 Python 库

• DOI: 10.3390/w13131850
• 发表时间: 2021
• 期刊: Water
• 影响因子: 3.4
• 作者: Bustamante, Giovanni Romero;Nelson, Everett James;Ames, Daniel P.;Williams, Gustavious P.;Jones, Norman L.;Boldrini, Enrico;Chernov, Igor;Sanchez Lozano, Jorge Luis
• 通讯作者: Sanchez Lozano, Jorge Luis

Integrating scientific cyberinfrastructures to improve reproducibility in computational hydrology: Example for HydroShare and GeoTrust

集成科学网络基础设施以提高计算水文学的可重复性：HydroShare 和 GeoTrust 示例

• DOI: 10.1016/j.envsoft.2018.03.025
• 发表时间: 2018
• 期刊: Environmental Modelling & Software
• 影响因子: 4.9
• 作者: Essawy, Bakinam T.;Goodall, Jonathan L.;Zell, Wesley;Voce, Daniel;Morsy, Mohamed M.;Sadler, Jeffrey;Yuan, Zhihao;Malik, Tanu
• 通讯作者: Malik, Tanu

Notebooks for combining the National Water Model results/inputs with observations from SNOTEL and MODIS at SNOTEL sites

用于将国家水模型结果/输入与 SNOTEL 和 MODIS 在 SNOTEL 站点的观测结果相结合的笔记本

• DOI: 10.4211/hs.493e0ad05c2d45199427cc41a6c76de0
• 发表时间: 2022
• 期刊: HydroShare
• 作者: Garousi-Nejad, Irene;Tarboton, David
• 通讯作者: Tarboton, David

Assessing the state of research data publication in hydrology: A perspective from the Consortium of Universities for the Advancement of Hydrologic Science, Incorporated

评估水文学研究数据出版的状况：来自水文科学促进大学联盟的视角

• DOI: 10.1002/wat2.1422
• 发表时间: 2020
• 期刊: WIREs Water
• 影响因子: 8.2
• 作者: Horsburgh, Jeffery S.;Hooper, Richard P.;Bales, Jerad;Hedstrom, Margaret;Imker, Heidi J.;Lehnert, Kerstin A.;Shanley, Lea A.;Stall, Shelley
• 通讯作者: Stall, Shelley