CC* Compute: A Cost-Effective, 2,048 Core InfiniBand Cluster at UTC for Campus Research and Education

CC* 计算：UTC 的具有成本效益的 2,048 核心 InfiniBand 集群，用于校园研究和教育

• 批准号: 1925603
• 负责人: Anthony Skjellum
• 金额: $ 39.22万
• 依托单位: University of Tennessee Chattanooga
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1925603&HistoricalAwards=false
• 关键词: CC; Compute; Cost; Effective; 048

A team of researchers at the University of Tennessee at Chattanooga (UTC) will make a significant upgrade to the campus cyberinfrastructure that will provide state-of-the-art, cost-effective high-performance computing not previously possible. This project will significantly improve university researchers' and students' ability to perform, enhance, and expand their current computationally-intensive research, prototyping, and development activities and will complement other investments already made, in-progress, or on the plan-of-record of UTC, including access to commercial cloud computing services. In addition to computer science and engineering, the UTC team anticipates significant research projects in mathematics, hydrology and computational fluid dynamics which will engage four regional partner universities. Two teaching projects address HPC education and use of HPC for mechanical engineering undergraduate research/design. In addition to these funded projects, merited additional research projects are enabled over time as the PIs, Central IT, and the cluster's Advisory Board attract and onboard additional researchers and students requiring HPC. Among other users are the more than 20 computational science Ph.D. students, plus several postdocs. Furthermore, SimCenter---UTC's research computing hub---supports undergraduate research through self-funding and REU in HPC, providing additional users for the proposed cluster. This award allows the University of Tennessee at Chattanooga (UTC) to procure an innovative, 2,048-compute core, 16-server AMD EPYC2 cluster networked with 100Gbit/s InfiniBand plus 8TB of main memory and 77 Tflop/s of double-precision floating point arithmetic. EPYC2 Rome 7nm processors will be newly available at or near the start of the period of performance, so this project includes state-of-the-art, cost-effective, high-performance computing not previously possible using Intel or AMD processors. The university has invested in a "commodity" cluster as recently as three years ago, and it is heavily utilized by the existing user base. This system will be nearly four years old by the beginning of this proposed grant. By way of complement, upgrades to storage (1.1PB), internal networking, data center infrastructure, and private cloud virtualization (coming online by mid-2019) have prepared UTC to support a new campus-wide cluster with a growing number of users in addition to those named here. The proposed new campus cluster will enable core scales and total cluster memory not previously available on campus and thus help researchers prepare their scalable problem scenarios for greater scales on national resources such as XSEDE. Projects enabled immediately are 14 science driver projects (12 research, two teaching). Seven projects involve four regional partner universities. At least ten NSF grants at UTK, UTC, UAB, Tennessee Tech, and Ole Miss are enhanced. Project areas highlighted include fault-tolerant parallel computing, performance monitoring of HPC, next-generation parallel programming with MPI, special-purpose linear algebra, hydrology, and computational fluid dynamics research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

位于查塔努加的田纳西大学（UTC）的一个研究小组将对校园网络基础设施进行重大升级，这将提供以前不可能实现的最先进、经济高效的高性能计算。 该项目将显著提高大学研究人员和学生执行、增强和扩展其当前计算密集型研究、原型设计和开发活动的能力，并将补充UTC已经进行的、正在进行的或计划中的其他投资，包括获得商业云计算服务。除了计算机科学和工程之外，UTC团队还预计将在数学、水文学和计算流体动力学方面开展重大研究项目，这些项目将涉及四所区域合作大学。 两个教学项目涉及HPC教育和HPC在机械工程本科研究/设计中的应用。除了这些受资助的项目外，随着PI、中央IT和集群咨询委员会吸引并加入需要HPC的其他研究人员和学生，随着时间的推移，还将启用值得的其他研究项目。其他用户包括20多名计算科学博士。学生，还有几名博士后。此外，SimCenter--UTC的研究计算中心--通过自筹资金和高性能计算中的REU支持本科生研究，为拟议的集群提供更多用户。该合同使田纳西大学查塔努加分校（UTC）能够采购一个创新的、2，048个计算核心、16台服务器的AMD EPYC 2集群，该集群与100 Gbit/s InfiniBand以及8 TB主内存和77 Tflop/s双精度浮点运算联网。EPYC 2罗马7纳米处理器将在性能期开始时或接近开始时全新上市，因此该项目包括了英特尔或AMD处理器无法实现的最先进、经济高效的高性能计算。该大学最近在三年前投资了一个"商品"集群，现有用户群大量使用该集群。到本拟议赠款开始时，这一制度将有近四年的历史。作为补充，对存储（1.1PB）、内部网络、数据中心基础设施和私有云虚拟化（将于2019年年中上线）的升级使UTC准备好支持新的校园范围的集群，除了这里提到的用户之外，还有越来越多的用户。拟议中的新校园集群将使核心规模和总集群内存以前没有在校园，从而帮助研究人员准备他们的可扩展问题的情况下，更大规模的国家资源，如XSEDE。立即启用的项目是14个科学驱动项目（12个研究，两个教学）。七个项目涉及四个区域伙伴大学。 UTK、UTC、UAB、田纳西理工学院和奥莱小姐至少有十个NSF赠款得到加强。重点项目领域包括容错并行计算、HPC性能监控、下一代MPI并行编程、特殊用途线性代数、水文学和计算流体动力学研究。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Implementation and evaluation of MPI 4.0 partitioned communication libraries

MPI 4.0分区通信库的实现和评估

• DOI: 10.1016/j.parco.2021.102827
• 发表时间: 2021
• 期刊: Parallel Computing
• 影响因子: 1.4
• 作者: Dosanjh, Matthew G.F.;Worley, Andrew;Schafer, Derek;Soundararajan, Prema;Ghafoor, Sheikh;Skjellum, Anthony;Bangalore, Purushotham V.;Grant, Ryan E.
• 通讯作者: Grant, Ryan E.

Design of a Portable Implementation of Partitioned Point-to-Point Communication Primitives

分区点对点通信原语的便携式实现的设计

• DOI: 10.1145/3458744.3474046
• 发表时间: 2021
• 期刊: ICPP Workshops '21: 50th International Conference on Parallel Processing Workshop
• 作者: Worley, Andrew;Prema Soundararajan, Prema;Schafer, Derek;Bangalore, Purushotham;Grant, Ryan;Dosanjh, Matthew;Skjellum, Anthony;Ghafoor, Sheikh
• 通讯作者: Ghafoor, Sheikh