CC* Compute: A Cost-Effective, 2,048 Core InfiniBand Cluster at UTC for Campus Research and Education

CC* 计算：UTC 的具有成本效益的 2,048 核心 InfiniBand 集群，用于校园研究和教育

• 批准号: 1925603
• 负责人: Anthony Skjellum
• 金额: $ 39.22万
• 依托单位: University of Tennessee Chattanooga
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1925603&HistoricalAwards=false
• 关键词: CC; Compute; Cost; Effective; 048

A team of researchers at the University of Tennessee at Chattanooga (UTC) will make a significant upgrade to the campus cyberinfrastructure that will provide state-of-the-art, cost-effective high-performance computing not previously possible. This project will significantly improve university researchers' and students' ability to perform, enhance, and expand their current computationally-intensive research, prototyping, and development activities and will complement other investments already made, in-progress, or on the plan-of-record of UTC, including access to commercial cloud computing services. In addition to computer science and engineering, the UTC team anticipates significant research projects in mathematics, hydrology and computational fluid dynamics which will engage four regional partner universities. Two teaching projects address HPC education and use of HPC for mechanical engineering undergraduate research/design. In addition to these funded projects, merited additional research projects are enabled over time as the PIs, Central IT, and the cluster's Advisory Board attract and onboard additional researchers and students requiring HPC. Among other users are the more than 20 computational science Ph.D. students, plus several postdocs. Furthermore, SimCenter---UTC's research computing hub---supports undergraduate research through self-funding and REU in HPC, providing additional users for the proposed cluster. This award allows the University of Tennessee at Chattanooga (UTC) to procure an innovative, 2,048-compute core, 16-server AMD EPYC2 cluster networked with 100Gbit/s InfiniBand plus 8TB of main memory and 77 Tflop/s of double-precision floating point arithmetic. EPYC2 Rome 7nm processors will be newly available at or near the start of the period of performance, so this project includes state-of-the-art, cost-effective, high-performance computing not previously possible using Intel or AMD processors. The university has invested in a "commodity" cluster as recently as three years ago, and it is heavily utilized by the existing user base. This system will be nearly four years old by the beginning of this proposed grant. By way of complement, upgrades to storage (1.1PB), internal networking, data center infrastructure, and private cloud virtualization (coming online by mid-2019) have prepared UTC to support a new campus-wide cluster with a growing number of users in addition to those named here. The proposed new campus cluster will enable core scales and total cluster memory not previously available on campus and thus help researchers prepare their scalable problem scenarios for greater scales on national resources such as XSEDE. Projects enabled immediately are 14 science driver projects (12 research, two teaching). Seven projects involve four regional partner universities. At least ten NSF grants at UTK, UTC, UAB, Tennessee Tech, and Ole Miss are enhanced. Project areas highlighted include fault-tolerant parallel computing, performance monitoring of HPC, next-generation parallel programming with MPI, special-purpose linear algebra, hydrology, and computational fluid dynamics research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

田纳西大学查塔努加大学（UTC）的一组研究人员将对Cyber​​infrasture进行重大升级，该校园将提供以前无法提供最先进的，具有成本效益的高性能计算的。 该项目将显着提高大学研究人员和学生的执行，增强和扩展其当前计算密集型研究，原型制作和开发活动的能力，并将补充已经进行的其他投资，正在进行中或UTC录制的UTC计划，包括访问商业云计算服务。除了计算机科学和工程外，UTC团队还预计，数学，水文学和计算流体动力学的重要研究项目将与四个区域合作伙伴大学相关。 两个教学项目涉及HPC教育和HPC用于机械工程本科研究/设计的使用。除了这些资助的项目外，随着PIS，Central IT和集群的顾问委员会吸引和登上需要HPC的学生，随着PIS，Central IT和集群的顾问委员会的吸引并在船上需要HPC，随着时间的推移，还可以进行其他研究项目。在其他用户中，有20多个计算科学博士学位。学生，加上几个博士后。此外，Simcenter --- UTC的研究计算中心---通过HPC的自筹资金和REU支持本科研究，为拟议的集群提供了其他用户。该奖项允许田纳西大学查塔努加大学（UTC）购买创新的，2,048计算机的核心，16服务器AMD AMD EPYC2集群，该集群与100Gbit/s Infiniband和8TB的主存储器和77 Tflop/S tflop/s的双确定浮点浮点数。 EPYC2 ROME 7NM处理器将在绩效期开始或接近新近可用，因此该项目包括先前使用Intel或AMD处理器以前无法使用的最先进的，具有成本效益的高性能计算。该大学在三年前就已经投资了一个“商品”集群，并被现有用户群大量利用。该系统将在这项提议的赠款开始之初将近四年。通过补充，升级到存储（1.1pb），内部网络，数据中心基础架构和私人云虚拟化（2019年中期将在线上线）已准备好支持新的校园范围内的新群集，除了此处命名的用户外，还有越来越多的用户。拟议的新校园集群将使核心量表和校园中无法获得的总集群记忆，因此可以帮助研究人员准备其可扩展的问题方案，以了解更大的国家资源（例如XSEDE）。启用的项目立即是14个科学驱动程序项目（12个研究，两项教学）。七个项目涉及四所区域合作伙伴大学。 在UTK，UTC，UAB，田纳西理工学院和Ole Miss至少有十项NSF补助金得到了增强。 Project areas highlighted include fault-tolerant parallel computing, performance monitoring of HPC, next-generation parallel programming with MPI, special-purpose linear algebra, hydrology, and computational fluid dynamics research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

项目成果

Implementation and evaluation of MPI 4.0 partitioned communication libraries

MPI 4.0分区通信库的实现和评估

• DOI: 10.1016/j.parco.2021.102827
• 发表时间: 2021
• 期刊: Parallel Computing
• 影响因子: 1.4
• 作者: Dosanjh, Matthew G.F.;Worley, Andrew;Schafer, Derek;Soundararajan, Prema;Ghafoor, Sheikh;Skjellum, Anthony;Bangalore, Purushotham V.;Grant, Ryan E.
• 通讯作者: Grant, Ryan E.

Design of a Portable Implementation of Partitioned Point-to-Point Communication Primitives

分区点对点通信原语的便携式实现的设计

• DOI: 10.1145/3458744.3474046
• 发表时间: 2021
• 期刊: ICPP Workshops '21: 50th International Conference on Parallel Processing Workshop
• 作者: Worley, Andrew;Prema Soundararajan, Prema;Schafer, Derek;Bangalore, Purushotham;Grant, Ryan;Dosanjh, Matthew;Skjellum, Anthony;Ghafoor, Sheikh
• 通讯作者: Ghafoor, Sheikh