Collaborative Research: Framework: Data: Toward Exascale Community Ocean Circulation Modeling

本项目设计并实现了一个处理pb级数据集的软件框架；重点是全球海洋环流。一个由三所大学（约翰霍普金斯大学、麻省理工学院和哥伦比亚大学）组成的团队建立了一个统一的数据系统，能够提供1公里水平分辨率的全球海洋环流模型输出。该产品将托管在一个开放的门户网站上，为社区提供可扩展的软件工具，以便对数据集进行分析。研究小组将利用这些数据来回答有关海洋中混合和消散过程的具体问题。这项工作的目标是创建和演示一个完整的和可复制的网络基础设施，用于共享和分析大规模模拟。重点是高分辨率的海洋环流建模，软件工具将实现高效存储。解决了海洋和气候动力学研究的两个主要挑战：处理高分辨率模拟的大数据集，以及理解小尺度海洋过程在大尺度海洋/气候系统中的作用。解决第一个挑战将极大地促进目前和未来对海洋/大气/气候系统的研究；解决第二个挑战将大大提高对海洋/气候动力学的理解。该项目建立了一个统一的数据系统，包括高分辨率的全球海洋环流模拟、用于数据共享的千万亿级门户和用于交互式分析的可扩展软件工具。该项目的软件框架有望为用户处理千兆级到百亿亿级的数据集。该项目利用了几个现有的功能：东格陵兰大陆斜坡上Spill Jet的JHU区域数值模型、Pangeo项目的软件、SciServer数据密集型软件基础设施，以及从东北存储交换多pb区域数据存储中吸取的经验教训。更广泛的目标是下一代地球科学和其他学科的模拟软件。该奖项由美国国家科学基金会高级网络基础设施办公室颁发，由海洋科学部和美国国家科学基金会地球科学理事会的综合协作教育与研究计划共同支持。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project designs and implements a software framework for handling petabyte-scale datasets; the focus is on global ocean circulation. A team of three universities (Johns Hopkins University, MIT, and Columbia University) builds a unified data system that is capable of delivering global ocean circulation model output at 1 km horizontal resolution. The product will be hosted in an open portal, providing the community with scalable software tools to enable analysis of the dataset. The team will use this data to answer specific questions about mixing and dissipation processes in the ocean. The goal of this effort is the creation and demonstration of a complete and replicable cyberinfrastructure for sharing and analysis of massive simulations. The focus is on high resolution ocean circulation modeling, with software tools that will enable efficient storage. Two major challenges to the study of ocean and climate dynamics are addressed: handling large datasets from high-resolution simulations, and understanding the role of small-scale ocean processes in large-scale ocean/climate systems. Resolving the first challenge would significantly facilitate ongoing and future studies of the ocean/atmosphere/climate system; addressing the second challenge would profoundly improve understanding of ocean/climate dynamics. The project builds a unified data system consisting of high-resolution global ocean circulation simulations, a petascale portal for data sharing, and scalable software tools for interactive analysis. The software framework from this project is expected to handle petascale to exascale datasets for users. Several pre-existing capabilities are leveraged for this project: the JHU regional numerical model of the Spill Jet on the East Greenland continental slope, software from the Pangeo project, the SciServer data-intensive software infrastructure, and lessons learned from the North East Storage Exchange multi-petabyte regional data store. The broader target is next generation simulation software in the geosciences and other disciplines. This award by the NSF Office of Advanced Cyberinfrastructure is jointly supported by the Division of Ocean Sciences and the Integrative and Collaborative Education and Research Program within the NSF Directorate for Geosciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.