Collaborative Research: SI2-SSI: Cyberinfrastructure for Advancing Hydrologic Knowledge through Collaborative Integration of Data Science, Modeling and Analysis

全国和世界各地的研究人员花费了巨大的资源来收集和分析大量的水文数据，并建立了无数的模型，以更好地了解水文现象，并找到解决棘手的水问题的方法。这些研究人员的资金、时间、计算能力、数据存储以及将数据用于生产用途的能力都是有限的。如果他们能联合起来使合作更容易呢？如果这些收集的数据集和经过处理的模型输出可以协同使用，以帮助推进对水文学的理解，而不仅仅是它们最初的目的，那会怎么样？HydroShare是一个推进水文科学的系统，它使科学界能够更容易、更自由地分享他们的研究成果，不仅是总结研究的科学出版物，还包括用于创建科学出版物的数据和模型。HydroShare支持水文数据和模型的共享和发布。这种能力对于社区模型的开发、执行和评估以及通过透明度提高科学发现的可再现性和社区信任是必要的。作为一个在先进计算基础设施上进行协作和运行模型的平台，HydroShare增强了水文学和其他相关科学的数据密集型研究能力。HydroShare旨在帮助研究人员轻松满足数据管理计划的共享要求，同时提供增值功能，使元数据捕获更有效，并帮助研究人员提高工作效率。该项目将扩展HydroShare网络基础设施的能力，以加强对科学方法的支持，推进HydroShare的社会能力，以实现更好的协作研究，与第三方消费者数据存储系统集成，以提供更灵活和可持续的数据存储。并建立一个应用测试环境，使研究人员能够开发自己的计算机程序，以对HydroShare中的数据进行操作和处理。赋予HydroShare用户快速开发web应用程序的能力，为数据和模型的不可预见的创新组合打开了大门。WRF-Hydro是NOAA国家水模型的框架，将被用作模型开发合作的用例。由于WRF-Hydro被NOAA用作国家水模型（NWM）的一部分，这种合作为将研究转移到运营提供了可能性。总的来说，这个功能将提供一个计算框架，用于转变广泛的科学社区的实践，以利用数据科学和计算的进步并加速发现。HydroShare是一个共享水文数据和模型的系统，旨在为水文学家提供管理数据、创新和合作研究以解决水问题所需的网络基础设施。它解决了共享数据和水文模型的挑战，通过出版水文数据和模型来支持协作和可复制的水文科学。使用HydroShare用户可以：(1)与同事共享数据和模型；(2)管理共享内容的访问权限；(3)共享、获取、可视化和操作一系列广泛的水文数据类型和模型；(4)使用web服务接口实现编程自动化和客户端访问；(5)发布数据和模型，满足科研项目数据管理计划的要求；(6)发现和获取他人发表的数据和模型；(7)使用web应用程序对数据进行可视化、分析和运行模型。该项目将扩展HydroShare的能力，以便：(1)加强对科学方法的支持，从而实现系统的数据和模型分析以及假设检验；(2)提高HydroShare的社交能力，以实现更好的协作研究；(3)与第三方消费者数据存储系统集成，提供更灵活、可持续的数据存储；(4)建立一个应用测试环境，使研究人员能够开发自己的计算机程序，以对HydroShare中的数据进行操作和处理。HydroShare自2012年开始开发，并于2014年首次发布，支持水文数据和模型的共享和发布。这种能力对于社区模型的开发、执行和评估是必要的。作为一个远程协作和基于云计算的网络服务器平台，HydroShare增强了水文学和其他相关科学的数据密集型研究能力。从计算机科学和CI的角度来看，HydroShare是一种创新，它将计算和数据共享构建为一个网络计算平台，通过web应用程序（web apps）集成了数据存储、组织、发现和可编程操作。对这三个关键计算元素的支持使研究人员可以轻松地使用桌面之外的服务，使数据存储和操作更加可靠和可扩展，同时提高协作和重现结果的能力。通过整合来自多个来源的信息以及重用和协作丰富研究数据和模型，将加强新理解的产生。结构化和系统的模型过程相互比较和替代假设检验将成为可能，通过用户友好的CI，将推进水文建模的最新思想带给广泛的地球科学研究人员，从而改变研究实践和从这项研究中产生的知识。与消费者云存储的互操作性将大大简化进入HydroShare的内容，并支持其可持续性。将HydroShare严格的元数据模型与用户文件共享相结合，将增强可再现性，并为共享和协作提供创新机制。使HydroShare用户能够快速开发web应用程序，为数据和模型的不可预见的创新组合打开了大门。WRF- Hydro将被用作模型开发协作的用例。WRF-Hydro提供了基于河段的水文过程的高分辨率表示，并提供了将科学家聚集在一起的潜力，这些科学家的研究范围从1到100平方公里的流域，以及那些在区域到大陆尺度上工作的科学家，并跨越了从环境工程到水生生态学家的学科。由于WRF-Hydro被NOAA用作国家水模型（NWM）的一部分，这种合作为将研究转移到运营提供了可能性。该项目将采用CI中当前的最佳实践来实现互操作性和可扩展性，以服务于这个多学科的科学家社区。HydroShare已经产生了更广泛的影响，包括EarthCube在内的其他项目的使用和吸收都有快速增长的记录。作为促进水文科学大学联盟（CUAHSI）水数据中心（WDC）设施的一部分，它将成为可持续的社区CI。使用WRF- Hydro/NWM作为一个驱动用例，将推进基于社区的模型改进的CI。通过由国家气象局（NWS）支持并由CUAHSI运营的国家水中心（NWC）的夏季青年创新者计划，已经存在将研究成果转化为参与NWC的联邦机构的业务需求的途径。HydroShare已经触及了广泛而多样化的社区，用户基础包括美国土著部落、水文学科学学生和美国各地的教师研究人员。该提案建立在HydroShare的成功基础上，以扩展其功能，拓宽模型假设检验、协作数据共享和开放应用程序开发，跨越地球科学研究和教育。

Researchers across the country and around the world expend tremendous resources to gather and analyze vast stores of hydrologic data and populate a myriad of models to better understand hydrologic phenomena and find solutions to vexing water problems. Each of those researchers has limited money, time, computational capacity, data storage, and ability to put that data to productive use. What if they could combine their efforts to make collaboration easier? What if those collected data sets and processed model outputs could be used collaboratively to help advance hydrologic understanding beyond their original purpose? HydroShare is a system to advance hydrologic science by enabling the scientific community to more easily and freely share products resulting from their research, not just the scientific publication summarizing a study, but also the data and models used to create the scientific publication. HydroShare supports the sharing and publication of hydrologic data and models. This capability is necessary for community model development, execution, and evaluation and to improve reproducibility and community trust in scientific findings through transparency. As a platform for collaboration and running models on advanced computational infrastructure, HydroShare enhances the capability for data intensive research in hydrology and other aligned sciences. HydroShare is designed to help researchers easily meet the sharing requirements of data management plans while at the same time providing value added functionality that makes metadata capture more effective and helps researchers improve their work productivity. This project will extend the capabilities of the HydroShare cyberinfrastructure to enhance support for scientific methods, advance the social capabilities of HydroShare to enable improved collaborative research, integrate with 3rd party consumer data storage systems to provide more flexible and sustainable data storage. and establish an application testing environment to empower researchers to develop their own computer programs to act on and work with data in HydroShare. Empowering HydroShare users with the ability to rapidly develop web application programs opens the door to unforeseen, innovative combinations of data and models. WRF-Hydro, the framework for the NOAA National Water Model, will be used as a use case for collaboration on model development. Since WRF-Hydro is used by NOAA as part of the National Water Model (NWM), this collaboration opens possibilities for transfer of research to operations. Collectively, this functionality will provide a computing framework for transforming the practice of broad science communities to leverage advances in data science and computation and accelerate discovery.HydroShare is a system for sharing hydrologic data and models aimed at giving hydrologists the cyberinfrastructure needed to manage data, innovate and collaborate in research to solve water problems. It addresses the challenges of sharing data and hydrologic models to support collaboration and reproducible hydrologic science through the publication of hydrologic data and models. With HydroShare users can: (1) share data and models with colleagues; (2) manage who has access to shared content; (3) share, access, visualize and manipulate a broad set of hydrologic data types and models; (4) use the web services interface to program automated and client access; (5) publish data and models to meet the requirements of research project data management plans; (6) discover and access data and models published by others; and (7) use web apps to visualize, analyze, and run models on data. This project will extend the capabilities of HydroShare to: (1) enhance support for scientific methods enabling systematic data and model analysis and hypothesis testing; (2) advance the social capabilities of HydroShare to enable improved collaborative research; (3) integrate with 3rd party consumer data storage systems to provide more flexible and sustainable data storage; and (4) establish an application testing environment to empower researchers to develop their own computer programs to act on and work with data in HydroShare. Under development since 2012 and first released in 2014, HydroShare supports the sharing and publication of hydrologic data and models. This capability is necessary for community model development, execution, and evaluation. As a platform for collaboration and cloud based computation on network servers remote from the user, HydroShare enhances the capability for data intensive research in hydrology and other aligned sciences. HydroShare is innovative from a computer science and CI perspective in the way computation and data sharing are framed as a network computing platform that integrates data storage, organization, discovery, and programmable actions through web applications (web apps). Support for these three key elements of computation allows researchers to easily employ services beyond the desktop to make data storage and manipulation more reliable and scalable, while improving ability to collaborate and reproduce results. The generation of new understanding, through integration of information from multiple sources and reuse and collaborative enrichment of research data and models, will be enhanced. Structured and systematic model process intercomparisons and alternative hypothesis testing will be enabled, bringing, through user friendly CI, the latest thinking in advancing hydrologic modeling to a broad community of earth science researchers, thereby transforming research practices and the knowledge generated from this research. Interoperability with consumer cloud storage will greatly ease entry of content into HydroShare and support its sustainability. This meshing of the rigorous metadata model of HydroShare with consumer file sharing will enhance reproducibility as well as provide an innovative mechanism for sharing and collaboration. Empowering HydroShare users with the ability to rapidly develop web apps opens the door to unforeseen, innovative combinations of data and models. WRF- Hydro will be used as a use case for collaboration on model development. WRF-Hydro provides a reach-based high resolution representation of hydrologic processes, and offers the potential to bring together scientists working at scales from research catchments on the order of 1 to 100s of square kilometers as well as those working at regional to continental scales and cut across disciplines from environmental engineering to aquatic ecologists. Since WRF-Hydro is used by NOAA as part of the National Water Model (NWM), this collaboration opens possibilities for transfer of research to operations. This project will adapt current best practices in CI for interoperability and extensibility to serve this multidisciplinary community of scientists. HydroShare has already had a broader impact, with documented rapid growth in use and uptake by other projects including in EarthCube. It will become sustainable community CI through operation as part of the Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) Water Data Center (WDC) facility. The use of WRF- Hydro/NWM, as a driving use case, will advance CI for community based model improvement. Through the Summer Young Innovators Program at the National Water Center (NWC), supported by the National Weather Service (NWS) and operated by CUAHSI, a pathway already exists to translate research findings to the operational needs of federal agencies participating in the NWC. HydroShare already touches a broad and diverse community, with user base including Native American tribes, hydrologic science students, and faculty researchers across the U.S. This proposal builds on the success of HydroShare to extend its capabilities and broaden model hypothesis testing, collaborative data sharing, and open app development across earth science research and education.