OAC: Piloting the National Science Data Fabric: A Platform Agnostic Testbed for Democratizing Data Delivery

OAC：试点国家科学数据结构：用于民主化数据交付的平台无关测试平台

• 批准号: 2138811
• 负责人: Valerio Pascucci
• 金额: $ 560.93万
• 依托单位: University of Utah
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2138811&HistoricalAwards=false
• 关键词: OAC; Piloting; National; Science; Data

Ongoing investments from NSF and other agencies into shared experimental and computing facilities increase data generation by orders of magnitude and presents a challenge for universal, easy, and fast access to data by users and may limit the scientific impact of such facilities. This pilot seeks to demonstrate a trans-disciplinary National Science Data Fabric (NSDF) integrating access to and use of shared storage, networking, computing, and educational resources and, in doing so, will help democratize data-driven sciences through the development of a cyberinfrastructure (CI) platform designed for equitable access. This pilot connects an open network of researchers gathered around earth science, astronomy, biology, chemistry, physics, and materials science, to deploy a testbed for individual and shared scientific use. Supporting the IceCube neutrino observatory and the XenonNT dark matter detector will advance the understanding of the evolution of galaxies and the nature of dark matter and dark energy. Supporting the Materials Common enables the fast-paced design of new materials in critical fields such as energy, security, environment, and healthcare. Active involvement of Historically Black Colleges, the Minority Serving Cyberinfrastructure Consortium, and of Hispanic Serving Institutions assures true democratization of data-driven science and unleashes the intellectual potential of a genuinely diverse scientific community presenting the best potential for US innovation.The National Science Data Fabric (NSDF) pilot builds a testbed experimenting with critical technology needed to democratize data-driven sciences by constructing a CI platform designed for equitable access. In particular, NSDF experiments with key technologies that empower user communities to develop their solutions and support domain-specific requirements while avoiding duplication of technology. A programmable Content Delivery Network (CDN) will be a central component that interoperates with different appliances and storage solutions ranging from leadership-class computing facilities, campus-wide computing resources, commercial cloud, and research labs of individual investigators. With this strategy, NSDF connects storage, compute, and networking components with a software stack that empowers end-users with scalable tools that are easy to use, integrate and scale. Community-driven education and outreach will guarantee equitable access to all resources and engage an open network of universities, including minority-serving institutions in a federated data fabric configurable for individual and shared scientific use. By offering a shared, modular, containerized data delivery environment, operating at the best economies of scale, the NSDF pilot will demonstrate a key technology to fill the “missing middle” in the national computational infrastructure and will help address the “missing millions” challenge of American talent in STEM.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

NSF和其他机构对共享实验和计算设施的持续投资使数据生成增加了数量级，对用户普遍、轻松和快速地访问数据构成了挑战，并可能限制此类设施的科学影响。这一试点旨在展示一个跨学科的国家科学数据结构(NSDF)，它整合了共享存储、网络、计算和教育资源的获取和使用，并将通过开发一个旨在公平获取的网络基础设施(CI)平台，帮助推动数据驱动的科学的民主化。这一试点连接了一个围绕地球科学、天文学、生物学、化学、物理学和材料科学的开放的研究人员网络，以部署一个供个人和共享科学使用的试验台。支持冰立方中微子天文台和XenonNT暗物质探测器将促进对星系演化以及暗物质和暗能量性质的理解。支持材料通用使新材料在能源、安全、环境和医疗保健等关键领域的快速设计成为可能。历史上的黑人学院、少数族裔服务的网络基础设施联盟和西班牙裔服务机构的积极参与确保了数据驱动的科学的真正民主化，并释放了真正多样化的科学界的智力潜力，呈现出美国创新的最佳潜力。国家科学数据结构(NSDF)试点通过构建一个旨在公平访问的CI平台，建立了一个试验台，试验数据驱动的科学民主化所需的关键技术。特别是，NSDF试验了关键技术，使用户社区能够开发他们的解决方案并支持特定领域的需求，同时避免技术重复。可编程内容交付网络(CDN)将是与不同设备和存储解决方案互操作的核心组件，范围包括领先级别的计算设施、校园范围的计算资源、商业云和个人研究人员的研究实验室。通过此战略，NSDF将存储、计算和网络组件与一个软件堆栈连接起来，该软件堆栈为最终用户提供易于使用、集成和扩展的可扩展工具。以社区为导向的教育和外联将确保公平获得所有资源，并与大学建立一个开放的网络，包括在联邦数据结构中为少数群体服务的机构，该数据结构可配置用于个人和共享的科学用途。通过提供一个共享的、模块化的、集装箱化的数据交付环境，以最佳的规模经济运行，NSDF试点将展示一项关键技术，以填补国家计算基础设施中“缺失的中间”，并将帮助解决美国STEM人才“缺失的数百万”挑战。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

NSDF-Catalog: Lightweight Indexing Service for Democratizing Data Delivery

• DOI: 10.1109/ucc56403.2022.00011
• 发表时间: 2022-12
• 期刊: 2022 IEEE/ACM 15th International Conference on Utility and Cloud Computing (UCC)
• 作者: Jakob Luettgau;Christine R. Kirkpatrick;G. Scorzelli;Valerio Pascucci;G. Tarcea

AMM: Adaptive Multilinear Meshes

AMM：自适应多线性网格

• DOI: 10.1109/tvcg.2022.3165392
• 发表时间: 2022
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: Bhatia, Harsh;Hoang, Duong;Morrical, Nate;Pascucci, Valerio;Bremer, Peer-Timo;Lindstrom, Peter
• 通讯作者: Lindstrom, Peter

Development of Large-Scale Scientific Cyberinfrastructure and the Growing Opportunity to Democratize Access to Platforms and Data.

大规模科学网络基础设施的发展以及平台和数据访问民主化的机会不断增加。

• 发表时间: 2023
• 期刊: Proceedings of the 25TH International Conference On Human-Computer Interaction (HCII
• 作者: Jakob Luettgau, Giorgio Scorzelli

Leveraging Topological Events in Tracking Graphs for Understanding Particle Diffusion

利用跟踪图中的拓扑事件来理解粒子扩散

• DOI: 10.1111/cgf.14304
• 发表时间: 2021
• 期刊: Computer Graphics Forum
• 影响因子: 2.5
• 作者: McDonald, T.;Shrestha, R.;Yi, X.;Bhatia, H.;Chen, D.;Goswami, D.;Pascucci, V.;Turbyville, T.;Bremer, P.‐T.
• 通讯作者: Bremer, P.‐T.

NSDF-Cloud: Enabling Ad-Hoc Compute Clusters Across Academic and Commercial Clouds

NSDF-Cloud：跨学术和商业云启用临时计算集群

• DOI: 10.1145/3502181.3533710
• 发表时间: 2022
• 期刊: HPDC '22: Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing
• 作者: Luettgau, Jakob;Olaya, Paula;Zhou, Naweiluo;Scorzelli, Giorgio;Pascucci, Valerio;Taufer, Michela
• 通讯作者: Taufer, Michela