CC* Compute: Koa - A High Performance and Flexible Research Computing Resource
CC* Compute: Koa - A High Performance and Flexible Research Computing Resource
批准号:
2201428
负责人:
Sean Cleveland
金额:
$40.0万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2022
资助国家:
美国
项目状态:
已结题
起止时间:
2022-06-01 至 2024-05-31
中文摘要
该奖项全部或部分由《2021年美国救援计划法案》(公法117-2)资助。夏威夷大学(UH)的目标是建立CC* Compute: Koa -一个高性能和灵活的研究计算资源,以支持整个大学十个校区系统的计算密集型研究、教育和实践。该项目旨在安装一个计算集群Koa,它的架构是为了响应当前的资源限制,特别是临时存储。集群硬件包括750TB的刮刮存储,2个包含10张Nvidia A4000卡的GPU节点,8个计算节点共有384个CPU内核。Koa为UH的教师、研究人员和学生提供最先进的计算资源,专注于机器学习、人工智能和大规模模拟。Koa计算集群是一个共享的校园间资源,可供所有UH研究人员使用。Koa的重点是支持天文学、大气科学、海洋科学、微生物组科学和计算机与数据科学等专业的研究人员,这些研究跨越了UH的十个校区系统。Koa资源使研究人员能够扩大研究规模,以处理更大的数据集和模型,除了通过新的先进架构加速现有的工作流程外,还可以通过高速网络将极快的存储与计算资源联系起来,从而缩短得出结果的时间。与开放科学网格的战略伙伴关系允许国家研究社区有效地利用未使用的Koa资源,并为Koa用户提供一个通往国家计算平台的网关。此外,Koa资源通过与夏威夷数据科学研究所和当地社区合作,为下一代研究人员和数据科学家提供数据科学和计算科学方面的实践培训。Koa通过提供750TB的高速Lustre并行刮刮存储容量,可以从所有计算和GPU加速资源中访问,从而实现更大范围和规模的分析。Koa的200Gb HDR无限带宽网络使Koa的Lustre能够实现高达96Gb/s的I/O速度,并为I/O繁重的工作流程提供更高的计算吞吐量。Koa的外部网络连接通过100Gb/s数据传输节点连接和高速并行文件系统的结合,提高了对国家、商业云和学术资源的数据传输速度,增强了端到端的大数据工作流程。Koa还提供虚拟化基础设施来支持专门的计算用例,例如:沉浸式分析和科学网关。与开放科学网格的战略合作伙伴关系允许国家研究社区收集Koa上未使用的周期,以及为Koa用户提供国家计算平台的网关。Koa的高速文件系统与在UH托管的区域Jestream2 NSF云基础设施的集成使研究人员能够轻松地在云和本地Koa计算资源之间跨越计算环境和模式,以支持新的深度学习和人工智能工作流程、可视化和应用程序。该项目由高级网络基础设施办公室(OAC)和促进竞争研究既定计划(EPSCoR)共同资助。该奖项反映了美国国家科学基金会的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).The University of Hawaii (UH) aims to establish the CC* Compute: Koa - A High Performance and Flexible Research Computing Resource to support computationally intensive research, education and practice across the UH ten-campus system. The project aims to install a compute cluster Koa, which is architected in response to current resource constraints, particularly scratch storage. The cluster hardware includes scratch storage of 750TB, 2 Graphics Processing Unit (GPU) nodes comprising 10x Nvidia A4000 cards, and a total of 384 CPU cores across 8 compute nodes. Koa provides UH faculty, researchers and students state-of-the-art computational resources focused towards machine learning, artificial intelligence and large scale simulation. The Koa computing cluster is a shared inter-campus resource available to all UH researchers. Koa focuses to support researchers in the specialties of astronomy, atmospheric science, ocean science, microbiome science, and computer & data science, across UH's ten-campus system. Koa resources enable researchers to scale up research to process larger datasets and models in addition to accelerating existing workflows through the new advanced architecture that ties extremely fast storage to the compute resources over a high-speed network, which enables a shorter time to result. The strategic partnership with the Open Science Grid allows for efficient usage of unused Koa resources by the national research community as well as a gateway to a national compute platform for Koa users. Additionally, the Koa resource aids hands-on training in data science and computational science for the next generation of researchers and data scientists through partnership with the Hawaii data science institute and local community for workshops and classroom access.Koa enables a larger scope and scale of analysis by providing 750TB of high-speed Lustre parallel scratch storage capacity accessible from all compute and GPU accelerated resources. Koa’s 200Gb HDR infiniband network enables Koa’s Lustre to achieve I/O speeds up to 96Gb/s and provide increased computational throughput for I/O heavy workflows. Koa’s external network connections increase data transfer speeds to national, commercial cloud and academic resources via the combination of 100Gb/s data transfer node connection and high-speed parallel file system, enhancing end-to-end big data workflows. Koa also provides virtualized infrastructure to support specialized computational use cases such as: immersive analytics and science gateways. The strategic partnership with the Open Science Grid allows for harvesting unused cycles on Koa by the national research community as well as a gateway to national compute platform for Koa users. The integration of Koa’s high speed file system with the regional Jestream2 NSF Cloud infrastructure hosted at UH allows researchers to easily span computing environments and modalities between the cloud and local Koa computing resources to support new deep learning and artificial intelligence workflows, visualizations and applications.This project is funded through the collaborative efforts of the Office of Advanced Cyberinfrastructure (OAC) and the Established Program to Stimulate Competitive Research (EPSCoR).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
CC* Data Storage: KoaStore: A High Performance and Flexible Research Storage Resource
-
批准号:2232862
-
项目类别:Standard Grant
-
资助金额:$50.0万
-
财政年份:2022
-
负责人:Sean Cleveland
-
依托单位:
CyberTraining: Implementation: Medium: Cyberinfrastructure Training to Advance Environmental Science
-
批准号:2118222
-
项目类别:Standard Grant
-
资助金额:$99.93万
-
财政年份:2021
-
负责人:Sean Cleveland
-
依托单位:
Collaborative Proposal: Frameworks: Project Tapis: Next Generation Software for Distributed Research
-
批准号:1931575
-
项目类别:Standard Grant
-
资助金额:$99.72万
-
财政年份:2019
-
负责人:Sean Cleveland
-
依托单位:
海外基金