SHF: Small: Efficient CPU-GPU Communication for Heterogeneous Architectures

SHF：小型：异构架构的高效 CPU-GPU 通信

• 批准号: 1423108
• 负责人: Laxmi Bhuyan
• 金额: $ 49.9万
• 依托单位: University of California-Riverside
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-07-01 至 2019-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1423108&HistoricalAwards=false
• 关键词: SHF; Small; Efficient; CPU; GPU

Future chip multiprocessors (CMPs) will have silicon space and technology to incorporate hundreds of cores. The trend is to integrate tens of cores and hardware accelerators (HAs), such as GPUs, on a single platform. The proposed heterogeneous architecture will enable future chips to operate within their power budgets while providing the high-throughput per Watt required for large scientific applications. Many of the top-500 supercomputers integrate thousands of CPUs with GPU accelerators to achieve the desired throughput for scientific applications. Considerable effort, however, is needed to design efficient communication mechanisms between heterogeneous components in such a system. Currently, HAs are not fully integrated with the system architecture; offloading computation from the CPU to the HAs adds large communication overhead. This research project explores comprehensive solutions to this problem through many different techniques. The project has significant broader impact in terms of research publications, graduate student supervision, and minority education because UCR is a minority serving institution.This project will develop new CPU-GPU communication techniques through static programming and run-time optimization. It will develop a divisible load theory (DLT) technique to overlap communication with computation, and optimize the time and size of data transfer between the CPU and GPU. The research will also develop run-time techniques that can monitor the efficiency of execution and dynamically change the transfer parameters by considering the execution behaviors of different applications. Architectural changes are to be incorporated in the GPU to initiate data transfers based on task execution inside the GPU. Design of the shared virtual memory (SVM) architecture is to be developed, where the accelerator and system memories share a single virtual address space; and CPUs and HAs in the system will communicate through the SVM. The hardware controllers, memory management unit (MMU), GPU cache memory architectures, cache coherence protocols, and other interfaces between the GPU and CPU cores will also be designed. The project proposes suitable hybrid cache coherence protocols and efficient interconnection networks for scalable system design. Finally, run-time system and software interfaces will be developed that can execute multiple multithreaded applications on a heterogeneous multicore architecture.

未来的芯片多处理器(CMPS)将拥有硅片空间和技术，可以容纳数百个核心。趋势是在单一平台上集成数十个内核和硬件加速器(HAD)，例如GPU。拟议的异类架构将使未来的芯片能够在其功率预算内运行，同时提供大型科学应用所需的每瓦特高吞吐量。许多排名前500的超级计算机将数千个CPU与GPU加速器集成在一起，以实现科学应用程序所需的吞吐量。然而，需要付出相当大的努力来设计这样一个系统中不同组件之间的有效通信机制。目前，HAS没有与系统架构完全集成；将计算从CPU转移到HAS增加了很大的通信开销。这项研究项目通过许多不同的技术探索了这个问题的综合解决方案。该项目将通过静态编程和运行时优化开发新的CPU-GPU通信技术，在科研出版物、研究生指导和少数民族教育方面具有重大而广泛的影响，因为UCR是一个少数民族服务机构。它将开发一种可分负载理论(DLT)技术，将通信与计算重叠，并优化CPU和GPU之间的数据传输时间和大小。该研究还将开发运行时技术，该技术可以监控执行效率，并通过考虑不同应用程序的执行行为来动态更改传输参数。架构更改将被合并到GPU中，以基于GPU内的任务执行启动数据传输。设计了共享虚拟内存结构，其中加速器和系统内存共享一个虚拟地址空间；系统中的CPU和HAS将通过支持向量机进行通信。还将设计硬件控制器、内存管理单元(MMU)、GPU高速缓存体系结构、高速缓存一致性协议以及GPU和CPU内核之间的其他接口。该项目提出了适用于可扩展系统设计的混合缓存一致性协议和高效的互连网络。最后，将开发能够在异质多核架构上执行多个多线程应用程序的运行时系统和软件接口。