SHF: Medium: Energy Efficient Computing on GPU-based Heterogeneous Systems

设计未来多处理器的当前趋势是在单个平台上集成数百个内核和硬件加速器（HA），例如GPU。然而，随着系统规模的扩大，这些异构多处理器的功耗和能源消耗大大超过预算。该项目的主要重点是开发可以在GPU中实现的节能技术，并与CPU进行适当的协调。基于GPU的异构多处理器的能耗降低可以通过将当前的CPU技术扩展到GPU来实现。 该项目为GPU核心扩展和动态电压和频率扩展（DVFS）开发了新的运行时技术，并将其与算法和数据结构的基本变化相结合，以提高能源效率。现有的性能和能耗模型假设处理核心的利用率为100%，并且在执行期间与内存访问完美重叠。该项目开发了一个更准确的能源效率模型，考虑到不同应用程序的算法，数据结构，缓存和内存合并。正在开发一个运行时系统，该系统在执行应用程序时监控GPU核心和内存利用率以及能耗。运行时通过预测动态地调整核的数量和/或频率级别，但是随着执行的进行继续进行校正。运行时扩展到由CPU和GPU组成的异构系统，目前的DVFS技术不能完全消除松弛，因此不是能量最优的。利用线性代数算法的特点，提出了一种频率调度技术，在对应用进行任务划分和设计的同时，优化了应用的能量效率。不失一般性，Cholesky因式分解作为一个例子，开发了一个节能调度器。该项目开发的软件产品可以很容易地应用于现有的大规模异构计算机，执行适合国防，能源和关键基础设施项目的科学应用程序。此外，还开发了天气预报和结构动力学等应用，对社会产生了巨大影响。研究内容被整合到研究生课程中，为学生提供设计和编程异构系统的培训。该项目旨在培养高质量的博士生。毕业生，包括女生。滨江的加州大学以其大比例的西班牙裔学生而闻名，UCR是一所为少数民族服务的机构。该项目支持招收代表性不足的少数民族学生和女生。

The current trend in designing future multiprocessors is to integrate hundreds of cores and hardware accelerators (HAs), such as GPUs, on a single platform. However, as the system size scales, the power and energy consumption of these heterogeneous multiprocessors vastly exceed the budget. The primary focus of the project is to develop energy efficient techniques that can be implemented in the GPU with proper coordination with the CPUs. Energy reduction in GPU-based heterogeneous multiprocessors can be achieved by extending current CPU techniques to GPU. The project develops new runtime techniques for GPU core scaling and Dynamic Voltage and Frequency scaling (DVFS), and combines them with basic changes in algorithms and data structures to improve energy efficiency. Existing models for performance and energy consumption assume 100% utilization of the processing cores and perfect overlap with memory access during execution. This project develops a more accurate model for energy efficiency taking into account the algorithm, data structure, caching and memory coalescing for different applications. A runtime system is being developed that monitors the GPU core and memory utilizations together with the energy consumption while executing an application. The runtime adjusts the number of cores and/or frequency level dynamically through prediction, but continues to make corrections as the execution proceeds. The runtime is extended to heterogeneous systems consisting of both CPU and GPU.The current DVFS techniques for scientific computing applications cannot fully eliminate slacks, therefore, are not energy optimal. By leveraging the algorithmic characteristics, a frequency scheduling technique is developed for linear algebra applications to achieve better energy efficiency.The project optimizes the energy efficiency while partitioning and designing tasks of an application. Without loss of generality, Cholesky factorization is used as an example and an energy efficient scheduler is developed. The project develops software products that can be readily applied to existing large scale heterogeneous computers executing scientific applications that are suitable for defense, energy and critical infrastructure projects. Also applications like weather forecasting and structural dynamics are developed that have a great impact on society. The research content is integrated to graduate courses to provide training to students for designing and programming heterogeneous systems. The project aims to produce very high quality Ph.D. graduates including female students. The University of California, Riverside is known for its large proportion of Hispanic students, and UCR is a minority-serving institution. The project supports recruiting underrepresented minority and female students.