Category I: Jetstream 2: Accelerating Science and Engineering On-Demand

第一类：Jetstream 2：加速科学与工程按需发展

• 批准号: 2005506
• 负责人: David Hancock
• 金额: $ 1000万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Cooperative Agreement
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2025-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2005506&HistoricalAwards=false
• 关键词: Category; Jetstream; Accelerating; Science; Engineering

The frontiers of science are rapidly evolving in regard to availability of data to be analyzed and the breadth and variety of analytical tools that researchers use. To effectively analyze and make sense of this ever-growing cache of information, and to make it possible to leverage new artificial intelligence tools for research, researchers need on-demand, interactive, and programmatic cyberinfrastructure (CI) delivered via the cloud. Jetstream 2 is a system that will be easy to expand and reconfigure, and capable of supporting diverse modes of on-demand access and use, The system will also revolutionize the national cyberinfrastructure (CI) ecosystem by enabling “AI for Everyone” with virtual GPU capabilities and widespread outreach through the five partners, led by Indiana University. The project promises to enable the research community to use a greater variety of computational resources and to expand its reach into student populations, drawn from a broad range of disciplines, thus contributing to building the future STEM workforce.Jetstream 2 will be an 8 PetaFLOPS (PFLOPS) cloud computing system using next-generation AMD “Milan” CPUs and the latest NVIDIA Tensor Core GPUs with 18.5 petabytes (PB) of storage. Consisting of five computational systems, Jetstream 2’s primary system will be located at Indiana University, with four modest regional systems deployed nationwide at Arizona State University (ASU), Cornell University, the University of Hawaiʻi (UH), and the Texas Advanced Computing Center (TACC). Additional partnerships with the University of Arizona, Johns Hopkins University, and University Corporation for Atmospheric Research (UCAR) will contribute to Jetstream 2’s unparalleled usability and support for a broad range of scientific efforts.The Jetstream team has been at the forefront of training the research community to transition from batch computing methods to adopt cloud-style usage. Jetstream 2 will continue this path and will ease the transition between academic and commercial cloud computing. Some of the advanced features include push-button virtual clusters, advanced high-availability science gateways services (including commercial cloud integration), federated authentication for JupyterHubs, bare metal and virtualization within the same system through programmable CI, support for on-demand data intensive workloads in addition to on-demand computation, high-performance software-defined storage, and advanced multi-platform orchestration capabilities.Jetstream 2 will have far-reaching societal benefits. As enhanced educational infrastructure, it will serve more students, from traditional undergraduates to domain-science experts desiring training in computational techniques, than any other NSF-funded CI resource. These students will be better equipped to fully participate in the evolving STEM workforce. In addition to enabling new research, discovery, and innovation across many disciplines, Jetstream 2 will advance the national CI ecosystem and extend the broader impacts of existing NSF investments. Jetstream 2’s “Core Services” will demonstrate a practical model of distributed cloud computing that will give academic institutions an incentive to invest their own funds in new advanced CI facilities. Although modest in scale, these facilities will represent the state of the art in reconfigurable computing. The implementation of Jetstream 2 will also demonstrate that colleges and universities can invest sustainable amounts of their own funds in highly-effective, flexible CI resources that generate a significant return on investment. In sum, Jetstream 2 will transform the national CI landscape and greatly benefit the nation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

科学的前沿正在迅速发展，涉及到可供分析的数据以及研究人员使用的分析工具的广度和种类。为了有效地分析和理解这种不断增长的信息缓存，并使其能够利用新的人工智能工具进行研究，研究人员需要通过云提供按需，交互和编程的网络基础设施（CI）。Jetstream 2是一个易于扩展和重新配置的系统，能够支持多种按需访问和使用模式，该系统还将通过由印第安纳州大学领导的五个合作伙伴，通过虚拟GPU功能和广泛的推广，实现“每个人的人工智能”，从而彻底改变国家网络基础设施（CI）生态系统。该项目有望使研究界能够使用更多种类的计算资源，并将其范围扩大到来自广泛学科的学生群体，Jetstream 2将是一个8 PetaFLOPS（PFLOPS）的云计算系统，使用下一代AMD“米兰”CPU和最新的NVIDIA Tensor Core GPU，具有18.5 PB（PB）存储。Jetstream 2的主要系统由五个计算系统组成，将位于印第安纳州大学，四个适度的区域系统部署在亚利桑那州州立大学（ASU），康奈尔大学，夏威夷大学（UH）和德克萨斯州高级计算中心（TACC）。与亚利桑那大学、约翰霍普金斯大学和大学大气研究公司（UCAR）的其他合作伙伴关系将有助于Jetstream 2无与伦比的可用性和对广泛科学工作的支持。Jetstream团队一直处于培训研究社区从批处理计算方法过渡到采用云式使用的最前沿。Jetstream 2将继续这条道路，并将缓解学术和商业云计算之间的过渡。一些高级功能包括按钮式虚拟集群、高级高可用性科学网关服务（包括商业云集成），通过可编程CI在同一系统内对VMware Hub、裸机和虚拟化进行联合身份验证，支持按需数据密集型工作负载以及按需计算，高性能软件定义存储，和先进的多平台协调能力。Jetstream 2将产生深远的社会效益。作为增强的教育基础设施，它将为更多的学生提供服务，从传统的本科生到希望接受计算技术培训的领域科学专家，而不是任何其他NSF资助的CI资源。这些学生将能够更好地充分参与不断发展的STEM劳动力。除了在许多学科中实现新的研究、发现和创新外，Jetstream 2还将推动国家CI生态系统的发展，并扩大NSF现有投资的更广泛影响。Jetstream 2的“核心服务”将展示分布式云计算的实用模型，这将激励学术机构将自己的资金投入到新的先进CI设施中。虽然规模不大，这些设施将代表最先进的可重构计算。Jetstream 2的实施还将证明，高校可以将可持续的自有资金投入到高效、灵活的CI资源中，从而产生可观的投资回报。总之，Jetstream 2将改变国家CI景观，使国家受益匪浅。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Campus Bridging in the Age of COVID-19

COVID-19 时代的校园桥梁

• DOI: 10.1145/3569951.3597604
• 发表时间: 2023
• 期刊: ACM
• 作者: Coulter, Eric;Knepper, Richard;Reynolds, Resa;Bird, Stephen;Samuel, Tabitha Kripa;Snapp-Childs, Winona
• 通讯作者: Snapp-Childs, Winona

Airavata Metascheduler: A Reliable, Fault Tolerant, and Resource-Aware Job Scheduling Service

Airavata Metascheduler：可靠、容错且资源感知的作业调度服务

• DOI: 10.1145/3569951.3593605
• 发表时间: 2023
• 期刊: ACM
• 作者: Ranawaka, Isuru;Abeysinghe, Eroma;Wannipurage, Dimuthu;De Silva, Dinuka;Brookes, Emre;Marru, Suresh;Christie, Marcus;Pamidighantam, Sudhakar;Pierce, Marlon
• 通讯作者: Pierce, Marlon

A Framework to capture and reproduce the Absolute State of Jupyter Notebooks

捕获和重现 Jupyter Notebooks 绝对状态的框架

• DOI: 10.1145/3491418.3530296
• 发表时间: 2022
• 期刊: PEARC '22: Practice and Experience in Advanced Research Computing
• 作者: Wannipurage, Dimuthu;Marru, Suresh;Pierce, Marlon
• 通讯作者: Pierce, Marlon

Custos Secrets: a Service for Managing User-Provided Resource Credential Secrets for Science Gateways

• DOI: 10.1145/3491418.3535177
• 发表时间: 2022-07
• 期刊: Practice and Experience in Advanced Research Computing
• 作者: Isuru Ranawaka;N. Goonasekera;E. Afgan;J. Basney;S. Marru;M. Pierce

Cloud Computing for Research and Education Gets a Sweet Upgrade with CACAO

研究和教育云计算通过 CACAO 获得甜蜜升级

• DOI: 10.1145/3569951.3597555
• 发表时间: 2023
• 期刊: ACM
• 作者: Skidmore, Edwin;Cosi, Michele;Swetnam, Tyson;Merchant, Nirav;Xu, Zhouyun;Choi, Illyoung;Davey, Sean;Frady, Jeremy;Wall, Mariah;Yung, Michelle
• 通讯作者: Yung, Michelle