SHF: Small: DeSCPar: Decoupled Supply-Compute Communication Management for Heterogeneous, Accelerator-Oriented Parallelism

在过去的十年中，摩尔定律和Dennard缩放的减速已经要求计算朝着使用片上并行性进行显著转变，以便在可接受的功率预算下实现计算机系统性能缩放。除此之外，系统还大大增加了对异构处理元件和专用加速器的使用。这种异构的、面向加速器的并行性的复杂性在没有对程序员和编译器编写者进行充分抽象的情况下就暴露出来了。因此，实现高性能通常需要程序包括详细的、特定于平台的定制，特别是关于数据在存储器和计算元件之间移动以及从一个计算元件移动到另一个计算元件时的分级。这种平台特定的定制限制了这些程序的可移植性;当一个新的芯片实现发布时，通常需要大量的软件返工来恢复高性能。总的来说，结果是异构并行性降低了应用软件的性能可移植性。DeSCPar研究解决了这个问题，代表了提高可编程性的重要研究。开发的工具将作为免费软件分发，包括DeSCPar模拟器和设计工具。此外，该项目还包括一系列广泛的活动，以提高计算工作人员的多样性。DeSCPar方法使用解耦的供应-计算体系结构，在高度并行的高度异构系统上实现可移植的性能。受DecoupledExcit-Execute方法的启发，DeSCPar同样将值计算从内存访问和“馈送”它们的地址计算中分离出来。通过使用自动切片技术将代码分割成数据提供部分和计算部分，可以实现高性能存储器优化，同时保持高级别的应用程序可移植性。在DeSCPar中，值计算操作的目标是在CompD上运行，CompD可以是硬件加速器、专门优化的CPU或通用CPU。同样，内存供应代码针对的是SuppD，它可以针对其任务进行专门优化。通过采用SuppD和CompD单元的不同组合，可以构建丰富的异构系统，并且软件可以自动映射到它们上。本项目：（i）提出和原型化自动编译器技术（基于LLVM），用于切片和优化DeSCPar代码;（ii）提出和评估基于DeSCPar组织结构的硬件设计优化。

Over the past decade, the deceleration of Moore's Law and Dennard Scaling has required computing to make a dramatic shift towards the use of on-chip parallelism in order to achieve computer systems performance scaling at acceptable power budgets. Beyond that, systems have also dramatically increased their use of heterogeneous processing elements and specialized accelerators. Much of the complexity of this heterogeneous, accelerator-oriented parallelism is exposed without sufficient abstraction to programmers and compiler writers. As a result, achieving high performance often requires that programs include detailed, platform-specific tailoring, particularly regarding the staging of data as it moves between memory and compute elements, and from one compute element to another. This platform-specific tailoring limits the portability of such programs; when a new chip implementation is released, extensive software reworks are often required to reclaim that high performance. Overall, the result is that heterogeneous parallelism is reducing the performance portability of application software. The DeSCPar research attacks this problem and represents important research in improving programmability. Developed tools will be distributed as free software, including a DeSCPar simulator and design tools. In addition, the project includes a broad set of activities around improving the diversity of the computing workforce.The DeSCPar approach uses Decoupled Supply-Compute Parallelism to achieve portable performance on highly parallel highly-heterogeneous systems. Inspired by Decoupled Access-Execute approaches, DeSCPar likewise decouples value computations from the memory accesses and address computations that "feed" them. By using automated slicing techniques to split code into a data supply portion and a computation portion, high-performance memory optimizations can be achieved while retaining high-level application portability. In DeSCPar, value computation operations are targeted to run on a CompD which may be a hardware accelerator, a specifically-optimized CPU, or a general-purpose CPU. Likewise, memory supply code is aimed at a SuppD, which can be specifically optimized for its task. By employing varied combinations of SuppD and CompD units, richly heterogeneous systems can be built, and software can be automatically mapped onto them. This project: (i) proposes and prototypes automated compiler techniques (based on LLVM) for slicing and optimizing DeSCPar code; and (ii) proposes and evaluates hardware design optimizations based on the DeSCPar organizational structure.