EAGER: Preliminary Study to Demonstrate Feasibility and Advantages of Massively Parallel Server Processors

当今的数据中心面临着实现更高性能和提高能效的持续压力。然而，服务器处理器在现代数据中心中消耗了大部分能源，十多年来在性能和效率方面只取得了渐进式的改进。 该提案通过研究一种全新的处理器架构#8213;来解决问题的核心&，该架构是根据现代服务器工作负载的特性从头开始设计的―这项工作利用了服务器经常并发地服务类似的请求，并在请求之间执行相同的指令序列的观察结果。这意味着服务器的大量请求级并行性可以利用单指令多线程（SIMT）处理器设计来实现服务器处理器效率的大幅提高。 不幸的是，现有的SIMT架构#8213;最值得注意的是，由于服务器工作负载的严格服务质量要求，图形处理单元（GPU）#8213;基本上不具备利用这种请求级并行性的能力。因此，基于SIMT的服务器处理器需要显著不同的设计。该项目研究了将SIMT范式应用于计算堆栈不同层的服务器处理器的可行性和挑战，从微架构到内存层次结构到系统软件。该项目探讨了不同硬件和软件设计技术对SIMT服务器处理器的性能影响，以确定最有利于此类处理器的功能。研究结果将为显着提高服务器处理器的能源效率铺平道路，并为计算机体系结构和系统社区开辟新的研究方向。

Today's data centers are under constant pressure to achieve higher performance and improved energy efficiency. However, server processors, which consume the lion's share of energy in a modern data center, have only made incremental improvements in performance and efficiency in more than a decade. This proposal gets at the heart of the problem through investigating a novel processor architecture―designed from scratch with characteristics of modern server workloads in mind―that can provide unprecedented levels of performance and energy-efficiency to the data centers of the future.This work leverages the observation that servers frequently service similar requests concurrently, and execute the same instruction sequences across requests. This implies that the abundant request-level parallelism of servers can be harnessed with a Single-Instruction-Multiple-Threads (SIMT) processor design to achieve drastic improvement in server processor efficiency. Unfortunately, existing SIMT architectures―most notably, Graphical Processing Units (GPUs)―are fundamentally ill-equipped to exploit this request-level parallelism due to stringent quality of service requirements of server workloads. Therefore, significantly different designs are required for SIMT-based server processors. This project investigates the feasibility and challenges of applying the SIMT paradigm to server processors at different layers of the computing stack, from micro-architecture to memory hierarchy to system software. The project explores the performance effect of different hardware and software design techniques on SIMT server processors to identify the features that benefit such processors the most. The results will lay out a path toward significantly improving the energy efficiency of server processors, and open new research directions for the computer architecture and systems community.