SHF: Small: Understanding and Exploiting Software Defined Networks (SDN) in High Performance Computing (HPC) Environments

SHF：小型：理解和利用高性能计算 (HPC) 环境中的软件定义网络 (SDN)

• 批准号: 2007827
• 负责人: Xin Yuan
• 金额: $ 49.94万
• 依托单位: Florida State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2007827&HistoricalAwards=false
• 关键词: SHF; Small; Understanding; Exploiting; Software

In modern society, many science and technology domains such as physics, biology, and meteorology rely on powerful supercomputers to perform simulations and data analysis to advance knowledge and to serve the society. These supercomputers use specialized hardware and are expensive to build and operate. This project aims at developing novel techniques to build high-performance and low-cost supercomputers by exploiting the capabilities of the Software Defined Networking (SDN) technology that has demonstrated its effectiveness in data centers to reduce cost of setup and management. If successful, this research will change how supercomputers are constructed, and lower the cost. This will make high-performance computing (HPC) accessible to a broad audience and help the advances in many domains. The project will also support education through a curriculum development effort that integrates research and education. SDN manages network traffic and resources in a logically centralized manner, enabling it to seek globally near-optimal resource management solutions for a given optimization objective. This can lead to improved performance over existing interconnection network technologies, including the proprietary ones in high-end HPC systems. Additionally, SDN's widespread commodity use will accelerate technological advances with improved performance and reduced cost in comparison to proprietary technologies. In this project, effective SDN techniques that can lead to higher performance than the current HPC systems are developed; the performance bounds of SDN under different constraints in the HPC environment are established. Additionally, practical techniques that can be deployed with the current technology are developed and evaluated. These techniques spread across different layers of the software stack including network, operating system, and run-time system, and work in concert to exploit the SDN capabilities. Finally, a working proof-of-concept SDN-capable HPC system that incorporates the developed techniques is implemented and deployed. Through analysis, design, development, and experimentation, the strengths and weaknesses of SDN in comparison to the networking technology in HPC systems are clearly identified.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在现代社会，许多科学技术领域，如物理、生物、气象等，都依靠强大的超级计算机进行模拟和数据分析，以促进知识的进步和服务于社会。这些超级计算机使用专门的硬件，建造和操作起来都很昂贵。该项目旨在开发新的技术，通过利用软件定义网络(SDN)技术的能力来构建高性能和低成本的超级计算机，该技术已在数据中心证明了其降低安装和管理成本的有效性。如果成功，这项研究将改变超级计算机的构造方式，并降低成本。这将使高性能计算(HPC)为更广泛的受众所接受，并有助于许多领域的进步。该项目还将通过将研究与教育相结合的课程开发努力来支持教育。SDN以逻辑集中的方式管理网络流量和资源，使其能够为给定的优化目标寻求全局接近最佳的资源管理解决方案。这可以提高现有互连网络技术的性能，包括高端HPC系统中的专有技术。此外，SDN的广泛商用将加快技术进步，与专有技术相比，性能更好，成本更低。在这个项目中，开发了有效的SDN技术，可以带来比现有HPC系统更高的性能；建立了不同约束条件下的SDN在HPC环境下的性能界限。此外，还开发和评估了可与当前技术一起部署的实用技术。这些技术分布在软件堆栈的不同层，包括网络、操作系统和运行时系统，并协同工作以利用SDN功能。最后，结合所开发的技术，实现并部署了一个具有SDN功能的工作概念验证系统。通过分析、设计、开发和实验，明确了SDN与HPC系统中的网络技术相比的优势和劣势。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Encrypted All-reduce on Multi-core Clusters

多核集群上的加密 All-reduce

• DOI: 10.1109/ipccc51483.2021.9679399
• 发表时间: 2021
• 期刊: and Communications Conference (IPCCC
• 作者: Gavahi, Mohsen;Naser, Abu;Wu, Cong;Lahijani, Mehran Sadeghi;Wang, Zhi;Yuan, Xin
• 通讯作者: Yuan, Xin

Faster Yet Safer: Logging System Via Fixed-Key Blockcipher

• 发表时间: 2022
• 作者: V. Hoang;Cong Wu;Xin Yuan

A Simulation Study of Hardware Parameters for Future GPU-based HPC Platforms

未来基于 GPU 的 HPC 平台硬件参数仿真研究

• DOI: 10.1109/ipccc51483.2021.9679359
• 发表时间: 2021
• 期刊: and Communications Conference (IPCCC
• 作者: Bhowmik, Saptarshi;Jain, Nikhil;Yuan, Xin;Bhatele, Abhinav
• 通讯作者: Bhatele, Abhinav

Efficient Algorithms for Encrypted All-gather Operation

用于加密全收集操作的高效算法

• DOI: 10.1109/ipdps49936.2021.00045
• 发表时间: 2021
• 期刊: 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS
• 作者: Lahijani, Mehran Sadeghi;Naser, Abu;Wu, Cong;Gavahi, Mohsen;Hoang, Viet Tung;Wang, Zhi;Yuan, Xin
• 通讯作者: Yuan, Xin

Multi-Path Routing in the Jellyfish Network

Jellyfish 网络中的多路径路由

• 发表时间: 2021
• 期刊: IPDPS workshop on Scalable Networks for Advanced Computer Systems
• 作者: Alzaid, Zaid;Bhowmik, Saptarshi;Yuan, Xin
• 通讯作者: Yuan, Xin