CRII: OAC: Towards Efficient Memory Management on Terabyte-Scale CXL-Enabled Tiered Memory Systems

CRII：OAC：在支持 CXL 的 TB 级分层内存系统上实现高效内存管理

• 批准号: 2348350
• 负责人: Jie Ren
• 金额: $ 16.7万
• 依托单位: College of William and Mary
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-06-01 至 2026-05-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2348350&HistoricalAwards=false
• 关键词: CRII; OAC; Towards; Efficient; Memory

As modern computing environments evolve, the advent of Compute Express Link (CXL) and multitiered memory systems introduces significant advancements and complexities in memory management. Traditional memory management methods, primarily designed for uniform memory systems, fall short in these advanced, multi-tiered environments. This project proposes an Operating System (OS) level solution for memory management in CXL-enabled systems to maximize performance for various applications without requiring application modifications. This research aligns with national interests by enhancing technological capabilities, contributing to scientific progress, and potentially impacting national health and prosperity through improved computational infrastructure.This initiative delves into developing a robust memory management framework for terabyte-scale, CXL-enabled tiered memory systems. The research tackles these challenges through two main approaches: (1) An advanced page allocation mechanism that optimizes data distribution across different memory types, considering bandwidth and latency, functioning effectively without prior knowledge of application behavior. (2) A heuristic method for managing all memory pages, guided by accurate, low-overhead memory region-based profiling across the entire memory hierarchy. The proposed solution is noteworthy for its ability to address both latency and bandwidth considerations in multi-tiered memory systems, surpassing the capabilities of current approaches. The intellectual merit of this research lies in its potential to significantly enhance OS memory management and the understanding of heterogeneous memory systems. By addressing the complexities of managing diverse memory types on a large scale, the project is expected to dramatically improve the scalability and efficiency of computational infrastructures, enabling more complex data processing tasks. The broader impacts encompass facilitating the wider adoption of tiered memory systems, enhancing the scalability of computational infrastructures, and potentially influencing future operating system designs for managing heterogeneous memory systems at scale.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

随着现代计算环境的发展，Compute Express Link(CXL)和多层内存系统的出现在内存管理方面带来了显著的进步和复杂性。传统的内存管理方法主要是为统一内存系统设计的，在这些高级的多层环境中无法满足要求。该项目为启用CXL的系统中的内存管理提出了一个操作系统(OS)级别的解决方案，以最大限度地提高各种应用程序的性能，而无需修改应用程序。这项研究通过提高技术能力，促进科学进步，并通过改进计算基础设施来潜在地影响国家健康和繁荣，符合国家利益。该倡议致力于为TB级、支持CXL的分层存储系统开发强大的存储管理框架。这项研究通过两种主要方法来应对这些挑战：(1)高级页面分配机制，该机制考虑了带宽和延迟，优化了不同内存类型的数据分布，在不需要预先了解应用程序行为的情况下有效运行。(2)一种启发式方法，用于管理所有内存页，以跨整个内存层次的准确、低开销的基于内存区域的剖析为指导。值得注意的是，建议的解决方案能够同时解决多层存储系统中的延迟和带宽问题，超过了当前方法的能力。这项研究的智力价值在于它有可能显著增强操作系统内存管理和对异类内存系统的理解。通过解决大规模管理不同内存类型的复杂性，该项目预计将显著提高计算基础设施的可扩展性和效率，实现更复杂的数据处理任务。更广泛的影响包括促进分层内存系统的更广泛采用，增强计算基础设施的可扩展性，并可能影响未来用于大规模管理异类内存系统的操作系统设计。该奖项反映了NSF的法定使命，并已通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。