SPX: Collaborative Research: Memory Fabric: Data Management for Large-scale Hybrid Memory Systems

SPX：协作研究：内存结构：大规模混合内存系统的数据管理

• 批准号: 2132049
• 负责人: Xiaoyi Lu
• 金额: $ 45万
• 依托单位: University of California - Merced
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-05-15 至 2023-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2132049&HistoricalAwards=false
• 关键词: SPX; Collaborative; Research; Memory; Fabric

New large-scale high performance computing systems being developed for the national labs and by US industry, combine heterogeneous memory components, accelerators and accelerator-near memory, and programmable high-performance interconnects. These memory-rich designs are attractive as they provide the compute-near-data capacity needed for improving the time to scientific discovery, and for supporting new classes of latency-sensitive data-intensive applications. However, existing software stacks are not equipped to deal with the heterogeneity and complexity of these machine designs, which impacts application performance and machine efficiency. The Memory Fabric (MF) solution developed in this project provides new abstractions and mechanisms that permit the systems software stacks to gain deeper insight into applications' data usage patterns and requirements, and to coordinate the decisions concerning how data should be distributed across different memories, or exchanged along different interconnection paths. The Memory Fabric (MF) architecture introduces new data-centric abstractions, memory object and memory object flow, and accompanying memory and communications management methods. The higher-level information captured in the new abstractions empowers the MF runtime to better guide the underlying memory and interconnect management, and to mask the complexities of the underlying memory substrate. Additional benefits are derived from use of near-memory-fabric computation, including via dynamically inserted application-specific codes, which further specialize and accelerate the operations carried out by MF. MF is evaluated using several important application domains, including big data learning and analytics, and traditional high-performance scientific simulations. Its benefits include gains in application performance and resource efficiency, while shielding applications and application developers from the underlying machine details.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

新的大规模高性能计算系统正在为国家实验室和美国工业界开发，结合了异构存储器组件、加速器和加速器附近存储器以及可编程的高性能互连。这些内存丰富的设计很有吸引力，因为它们提供了缩短科学发现时间所需的近数据计算能力，并支持对延迟敏感的新型数据密集型应用程序。然而，现有的软件栈无法处理这些机器设计的异构性和复杂性，这影响了应用程序的性能和机器的效率。本项目开发的内存结构（Memory Fabric， MF）解决方案提供了新的抽象和机制，允许系统软件栈更深入地了解应用程序的数据使用模式和需求，并协调有关数据应该如何在不同的内存中分布或沿着不同的互连路径交换的决策。内存结构（Memory Fabric， MF）架构引入了新的以数据为中心的抽象、内存对象和内存对象流，以及相应的内存和通信管理方法。在新抽象中捕获的高级信息使MF运行时能够更好地指导底层内存和互连管理，并掩盖底层内存基板的复杂性。额外的好处来自于使用近内存结构计算，包括通过动态插入特定于应用程序的代码，这进一步专门化和加速了MF执行的操作。MF使用几个重要的应用领域进行评估，包括大数据学习和分析，以及传统的高性能科学模拟。它的好处包括提高应用程序性能和资源效率，同时保护应用程序和应用程序开发人员不受底层机器细节的影响。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Bayesian group testing with dilution effects.

• DOI: 10.1093/biostatistics/kxac004
• 发表时间: 2023-10-18
• 期刊: Biostatistics (Oxford, England)

NVMe-oAF: Towards Adaptive NVMe-oF for IO-Intensive Workloads on HPC Cloud

• DOI: 10.1145/3502181.3531476
• 发表时间: 2022-06
• 期刊: Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing
• 作者: Arjun Kashyap;Xiaoyi Lu

Arcadia: A Fast and Reliable Persistent Memory Replicated Log

• DOI: 10.48550/arxiv.2206.12495
• 发表时间: 2022-06
• 期刊: ArXiv
• 作者: Shashank Gugnani;S. Guthridge;Frank B. Schmuck;O. Anderson;Deepavali Bhagwat;Xiaoyi Lu

Understanding hot interconnects with an extensive benchmark survey

• DOI: 10.1016/j.tbench.2022.100074
• 发表时间: 2022-10
• 期刊: BenchCouncil Transactions on Benchmarks, Standards and Evaluations
• 作者: Yuke Li;Hao Qi;Gang Lu;Feng Jin;Yanfei Guo;Xiaoyi Lu

xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep Learning

• DOI: 10.1007/s11390-023-2894-6
• 发表时间: 2023-02
• 期刊: Journal of Computer Science and Technology
• 影响因子: 0.7
• 作者: Adam Weingram;Yuke Li;Hao Qi;Darren Ng;L. Dai;Xiaoyi Lu