Category I. Computing without Boundaries: Cyberinfrastructure for the Long Tail of Science

第一类：无边界计算：科学长尾的网络基础设施

• 批准号: 1928224
• 负责人: Michael Norman
• 金额: $ 1000万
• 依托单位: University of California-San Diego
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1928224&HistoricalAwards=false
• 关键词: Category; I.; Computing; without; Boundaries

Science and engineering rely upon an increasingly complex and integrated ecosystem of advanced computing and data systems, scientific software, and expertise to conduct research that leads to new knowledge and discovery, and improves the Nation's competitiveness and the health and welfare of its citizens. From the building blocks of life on earth to the deepest mysteries of the universe, researchers use this cyberinfrastructure (CI) to carry out computation and analysis at ever larger scales and complexity. Computing without Boundaries: Cyberinfrastructure for the Long Tail of Science is a transformational project from the San Diego Supercomputer Center at the University of California, San Diego, designed to address these challenges. The centerpiece of the project is the acquisition, deployment, and operation of Expanse, a powerful supercomputer that will complement and extend NSF's Innovative High-Performance Computing (HPC) program. Expanse will: 1) increase the capacity and performance for thousands of users of batch-oriented and science gateway computing; and 2) provide new capabilities that will enable research increasingly dependent upon heterogeneous and distributed resources composed into integrated and highly usable CI. Expanse will feature innovations in system software, operations, and support that extend its capabilities far beyond the limits of the physical system. Through its integration with the public cloud and the Open Science Grid, collaboration with the Science Gateway Community Institute, and support for composable systems, Expanse will become part of a more inclusive national CI. The long tail of computing reflects diversity in science, researchers, their institutions, and those who support and operate CI. The project will reach out to underserved and under-resourced communities, through new initiatives like HPC@MSI, which will allocate a portion of Expanse to Minority Serving Institutes via a rapid access allocation to help them quickly use this powerful new resource. Projected to have a peak speed of 5 Petaflop/s, Expanse will feature next-generation Intel Central Processing Units (CPUs), NVIDIA Graphics Processing Units (GPUs), and a Mellanox InfiniBand network. It will be composed of 13 SDSC Scalable Compute Units (SSCUs), each of which contains 56 CPU nodes and 4 GPU nodes along with over 60 TB of distributed non-volatile memory storage for user scratch. The SSCUs will be integrated with a 12-PB Lustre parallel file system and 7 PB of object storage. SDSC, along with its partners Dell and Aeon Computing, will deploy Expanse in SDSC's energy-efficient data center on the UCSD campus. Expanse will be connected to multiple high-performance research and education networks at 100 Gbps and reach thousands of users who require high performance, but modest-scale resources. Allocation and usage policies will be tailored to achieve fast turnaround and responsiveness. Experts in computational science, data-intensive computing, scientific workflows, and large-scale systems operations will support Expanse at the highest levels of utilization, reliability, and usability. Through integration with national CI, Expanse will enable new models of computing and research that require the full complement of HPC systems and simulation, experimental data analysis, and computational expertise to support and facilitate breakthrough science. Knowledge gained through the project will lead to improvements in algorithms, software, and systems management tools, as well as a better understanding of how integrated CI can be configured to support emerging research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

科学和工程依靠先进计算和数据系统、科学软件和专业知识组成的日益复杂和集成的生态系统来进行研究，从而产生新的知识和发现，并提高国家的竞争力及其公民的健康和福利。从地球上生命的组成部分到宇宙最深的奥秘，研究人员使用这种网络基础设施 (CI) 来进行更大规模和更复杂的计算和分析。无边界计算：科学长尾的网络基础设施是加州大学圣地亚哥分校圣地亚哥超级计算机中心的一个转型项目，旨在应对这些挑战。该项目的核心是收购、部署和运营 Expanse，这是一台功能强大的超级计算机，将补充和扩展 NSF 的创新高性能计算 (HPC) 计划。 Expanse 将： 1) 提高面向批处理和科学网关计算的数千用户的容量和性能； 2) 提供新的功能，使研究越来越依赖于组成集成且高度可用的 CI 的异构和分布式资源。 Expanse 将在系统软件、操作和支持方面进行创新，使其功能远远超出物理系统的限制。通过与公共云和开放科学网格的集成、与 Science Gateway 社区研究所的合作以及对可组合系统的支持，Expanse 将成为更具包容性的国家 CI 的一部分。计算的长尾反映了科学、研究人员、其机构以及支持和运营 CI 的人员的多样性。该项目将通过 HPC@MSI 等新举措覆盖服务不足和资源不足的社区，该举措将通过快速访问分配将一部分 Expanse 分配给少数族裔服务机构，帮助他们快速使用这一强大的新资源。 Expanse 预计峰值速度为 5 Petaflop/s，将采用下一代英特尔中央处理单元 (CPU)、NVIDIA 图形处理单元 (GPU) 和 Mellanox InfiniBand 网络。它将由 13 个 SDSC 可扩展计算单元 (SSCU) 组成，每个单元包含 56 个 CPU 节点和 4 个 GPU 节点，以及超过 60 TB 的分布式非易失性内存存储供用户临时使用。 SSCU 将与 12 PB Lustre 并行文件系统和 7 PB 对象存储集成。 SDSC 与其合作伙伴 Dell 和 Aeon Computer 将在 UCSD 校园内的 SDSC 节能数据中心部署 Expanse。 Expanse 将以 100 Gbps 的速度连接到多个高性能研究和教育网络，并覆盖数千名需要高性能但规模适中的资源的用户。分配和使用政策将进行定制，以实现快速周转和响应能力。计算科学、数据密集型计算、科学工作流程和大规模系统操作方面的专家将为 Expanse 提供最高水平的利用率、可靠性和可用性支持。通过与国家 CI 集成，Expanse 将实现新的计算和研究模型，这些模型需要 HPC 系统和模拟、实验数据分析和计算专业知识的全面补充，以支持和促进突破性科学。通过该项目获得的知识将导致算法、软件和系统管理工具的改进，以及对如何配置集成 CI 来支持新兴研究的更好理解。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Expanse: Computing without Boundaries: Architecture, Deployment, and Early Operations Experiences of a Supercomputer Designed for the Rapid Evolution in Science and Engineering

Expanse：无边界计算：专为科学与工程快速发展而设计的超级计算机的架构、部署和早期运营经验

• DOI: 10.1145/3437359.3465588
• 发表时间: 2021
• 期刊: PEARC '21
• 作者: Strande, Shawn;Cai, Haisong;Tatineni, Mahidhar;Pfeiffer, Wayne;Irving, Christopher;Majumdar, Amit;Mishin, Dmitry;Sinkovits, Robert;Norman, Mike;Wolter, Nicole
• 通讯作者: Wolter, Nicole