SHF: Medium: Embracing Architectural Heterogeneity through Hardware-Software Co-design

过去十年见证了从高端数据中心到低成本嵌入式系统等不同应用领域的异构性激增，因为与同构多核体系结构相比，它们能够提供更好的性能和能效。这些系统通常包括作为计算引擎的CPU、GPU、FPGA和ASIC的子集，因此提出了独特的编程/资源管理挑战。然而，缺乏所需的编译器和运行时支持，对异类系统的广泛采用构成了障碍。此外，在针对给定面积/功率预算的各种计算引擎、存储器子系统和互连的数量和布置方面的底层异类体系结构的设计没有被充分探索，以满足各种应用需求。因此，必须以跨越应用程序、系统软件和底层硬件的统一方式调查整个系统堆栈，以便为高效的应用程序执行提供所需的支持。因此，本研究项目的主要目标是实现应用程序到不同计算引擎的动态映射，以提高性能/功率效率和系统利用率。该项目的结果将改变程序员和用户感知异构性并与之交互的方式。各种计算的研究将与宾夕法尼亚州立大学的教育活动和学生培训相结合，以培养未来的科学和工程劳动力，女研究生和本科生(荣誉)将积极参与。该项目包括四项任务。TASK-I旨在为不同硬件平台上的深度学习、云计算和高性能计算等各种应用领域进行基于配置文件的工作负载表征，以了解它们的性能/功率效用。这将被用来开发一个基于机器学习(ML)的模型，用于将任务初始分配给不同的计算引擎。TASK-II旨在探索编译器/编程支持，以将应用代码转换为适当的与设备无关的代码集，这些代码集充当跨不同硬件单元无缝调度和执行的粒度。TASK-III研究运行时支持，以优化调度并无缝地跨硬件单元移动代码，以提高系统性能。最后，任务四通过分析各种计算引擎在芯片上和芯片间的异构度、放置和集成、底层通信支持等问题来探索异构性平台的设计。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The last decade has witnessed a proliferation of heterogeneity across diverse application domains spanning from high-end datacenters to low-cost embedded systems, because they are capable of better performance and energy efficiency compared to homogeneous multicore architectures. These systems typically include a subset of CPUs, GPUs, FPGAs and ASICs as compute engines and hence, present unique programming/resource management challenges. However, the lack of required compiler and runtime support, present a barrier to the widespread adoption of heterogeneous systems. Furthermore, the design of the underlying heterogeneous architecture in terms of number and placement of various compute engines, memory subsystems and interconnects for a given area/power budget to satiate various application demands, is not fully explored. Therefore, it is imperative to investigate the entire system stack in a cohesive manner spanning applications, system software and underlying hardware for providing the required support for efficient application executions. Thus, the main goal of this research project is to enable dynamic mapping of an application to different computing engines for improving performance/power efficiency and system utilization. The outcomes of this project are poised to change the way the programmers and users perceive heterogeneity and interact with it. The research on heterogeneous computing will be integrated with the educational activities and student training at Penn State for nurturing the future workforce in science and engineering, with active participation of female graduate students and undergraduates (Honors) students. The project consists four tasks. Task-I aims at conducting a profile-based workload characterization for various application domains including deep learning, cloud computing and high-performance computing on diverse hardware platforms to understand their performance/power utility. This will be used to develop a machine-learning (ML) based model for initial assignment of tasks to different compute engines. Task-II is aimed at exploring compiler/programming support to transform application code into suitable device-agnostic 'codelets', that serve as the granularity for seamless scheduling and execution across different hardware units. Task-III investigates runtime support to optimally schedule and seamlessly move the codelets across the hardware units for improving system performance. Finally, Task-IV explores design of heterogeneous platforms by analyzing issues such as degree of heterogeneity, placement and integration of various computing engines on a chip and across chips, the underlying communication support.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.