SHF: Small: Cooperative Memory Expansion (COMEX) for Networked Computing Systems via Remote Direct Memory Access

SHF：小型：通过远程直接内存访问用于网络计算系统的协作内存扩展 (COMEX)

• 批准号: 1423302
• 负责人: Nian-Feng Tzeng
• 金额: $ 46万
• 依托单位: University of Louisiana at Lafayette
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-07-15 至 2018-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1423302&HistoricalAwards=false
• 关键词: SHF; Small; Cooperative; Memory; Expansion

Legacy and emerging applications with large working sets and, when executed on commodity servers, may exhibit poor performance due to frequent page faults which rely on the slow disk swap partition. This research aims to establish immense memory collectively across nodes of a networked computing system for holding pages evicted from the main memory of any participating nodes during application runs with large working sets, realizing cooperative memory expansion (COMEX). It has a great promise to advance technical understanding and scientific frontiers of networked computing systems. Given its wide adoption by operating systems and networking gear vendors nowadays, the remote direct memory access (RDMA) technology is adopted by COMEX for ultra-low latencies in page transfer between nodes whose OS kernel and CPU can be totally bypassed. This project deals with five technical challenges and the solution approaches to those challenges together will constitute the basis of the COMEX Handler, able to enhance execution performance and system throughput via better utilizing overall system DRAM memory on-demand. The project will also improve the research and educational activities on computer systems and distributed computing on the University of Louisiana at Lafayette campus, with its outcomes helping to integrate research and education for enriched teaching, training, and learning experience and to educate quality future workforce critical to the NSF mission, the state of Louisiana and the nation.

具有大型工作集的传统和新兴应用程序在商用服务器上执行时，可能会由于依赖于慢速磁盘交换分区的频繁页面错误而表现出较差的性能。本研究旨在建立跨网络计算系统的节点集体巨大的内存，以保持页面驱逐的任何参与节点的主存储器在应用程序运行与大的工作集，实现合作内存扩展（COMEX）。 它有一个很大的承诺，以促进技术理解和科学前沿的网络计算系统。 由于远程直接内存存取（RDMA）技术目前已被操作系统和网络设备供应商广泛采用，COMEX采用了这种技术，以便在节点之间进行超低延迟的页面传输，而这些节点可以完全绕过操作系统内核和CPU。 该项目涉及五个技术挑战，这些挑战的解决方案将共同构成COMEX DRAM的基础，能够通过更好地利用整个系统DRAM内存按需提高执行性能和系统吞吐量。 该项目还将改善路易斯安那大学拉斐特校区的计算机系统和分布式计算的研究和教育活动，其成果有助于整合研究和教育，以丰富教学，培训和学习经验，并教育对NSF使命，路易斯安那州和国家至关重要的高质量未来劳动力。