Research Infrastructure: CC* Data Storage: Multi-Petabyte Open Storage (MPOS) at the American Museum of Natural History

研究基础设施：CC* 数据存储：美国自然历史博物馆的多 PB 开放存储 (MPOS)

• 批准号: 2232857
• 负责人: Juan Montes
• 金额: $ 49.82万
• 依托单位: American Museum Natural History
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2232857&HistoricalAwards=false
• 关键词: Research; Infrastructure; CC; Data; Storage

This project provides the American Museum of Natural History (AMNH) a major expansion of data management and large-scale centralized storage supporting a broad range of research projects and provides supporting services to facilitate the acquisition, processing, and sharing of data. This significant expansion of storage and additional services allows AMNH to address storage and data management needs institutionally and addresses long-standing problems acutely felt across the Museum’s research divisions and graduate school. In this project, AMNH expands its data storage capabilities using Open Storage Network (OSN) storage pods, providing over 2 petabytes (PB) of centralized storage for active research data. The OSN pods are connected to the Museum’s Science DMZ, a high-performance network designed for research data flows, which provides connections to onsite high-performance computing (HPC) clusters, data transfer nodes (DTNs) in labs, and analytical systems, as well as to other institutions and resources in the cloud via a connection to the Internet2. The storage provided by the OSN pods is directly accessible by both local and cloud-based resources such as compute nodes at various cloud services and supercomputing centers nationally. AMNH leverages the Integrated Rule-Oriented Data System (iRODS) for data management, indexing, automated ingest, storage tiering, compliance, data integrity, and publishing services. The Clowder Framework provides a scalable data management framework supporting any data format across multiple research domains. Finally, AMNH makes available 20% of its allocated OSN storage to the shared OSN cloud, making it accessible to researchers nationally.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目为美国自然历史博物馆（AMNH）提供了支持广泛研究项目的数据管理和大规模集中存储的重大扩展，并提供支持服务，以促进数据的获取，处理和共享。存储和附加服务的这一重大扩展使AMNH能够从制度上解决存储和数据管理需求，并解决博物馆研究部门和研究生院长期存在的问题。在这个项目中，AMNH使用开放存储网络（OSN）存储吊舱扩展了其数据存储功能，为活跃的研究数据提供了超过2 PB的集中存储。OSN吊舱连接到博物馆的科学DMZ，这是一个专为研究数据流而设计的高性能网络，可连接到现场高性能计算（HPC）集群、实验室中的数据传输节点（DTN）和分析系统，以及通过连接到Internet 2的云中的其他机构和资源。OSN Pod提供的存储可由本地和基于云的资源直接访问，例如全国各种云服务和超级计算中心的计算节点。AMNH利用集成的面向规则的数据系统（iRODS）进行数据管理、索引、自动摄取、存储分层、合规性、数据完整性和发布服务。Clowder框架提供了一个可扩展的数据管理框架，支持跨多个研究领域的任何数据格式。最后，AMNH将其分配的OSN存储的20%提供给共享的OSN云，使其可供全国的研究人员访问。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。