ParaSol: Fine-Grained Thread-Level Parallelism for Single-Threaded Performance

自进入世纪以来，多核处理器在几乎所有的计算领域中已经变得司空见惯。性能不再仅仅来自于并行级并行（ILP）的提取，现在还需要软件开发人员或编译器将应用程序分解为多个指令流，以利用粗粒度的线程级并行（TLP）。虽然单线程性能对大类程序非常有益，但它仍然非常重要，特别是在执行速度可以支配整体程序性能的应用程序的顺序部分（有时被称为“Amdahl残酷定律”）。此外，单线程性能的改进对所有应用程序都有好处，因为每个线程都会经历性能提升，从而影响代码的所有部分-顺序和并行。向多核的转变是由复杂的无序硬件方案提取ILP的功率限制所驱动的（由底层晶体管技术中的Dennard缩放失败引起）。虽然设计者仍然增加了无序指令窗口，但不幸的是，这只会产生微小的差异，未来的设计预计将受到波拉克规则和ILP（ILP墙）的基本限制的限制。相反，尽管许多应用程序会看到利用TLP的主要性能提升，但实际上提取它仍然是一个挑战（John Hennessy说编写并行代码是“计算机科学所面临的最困难的问题”）。而不是回到未来的精心计划的乱序执行，它探讨了ILP和粗粒度的TLP利用现代多核之间的空间。特别是，它侧重于从内核内和内核间的单个指令流中提取细粒度的TLP。一方面，它将调查方案，以确定和自旋独立的短期运行线程（硬件线程）透明的应用程序，以提高单线程的性能。另一方面，它将研究编译器技术来表明这种并行性，硬件能够在多个紧密耦合的核心内和之间利用它。如果成功，该项目将导致高性能核心的性能发生阶跃变化，这是由核心资源利用率的提高以及以可扩展方式增加这些资源的能力所驱动的。它还将开辟更广阔的设计空间，用增加的TLP交换ILP的无序管道复杂性，以在面积、效率和应用领域适用性之间找到更好的平衡。

Since the turn of the century, multicore processors have become commonplace in almost all computing domains. Instead of performance coming solely from the extraction of instruction-level parallelism (ILP), it now also requires software developers or compilers to break applications into multiple streams of instructions to exploit coarse-grained thread-level parallelism (TLP). Whilst extremely beneficial for a large class of programs, single-threaded performance still matters greatly, especially during sequential parts of an application where execution speed can dominate overall program performance (sometimes dubbed "Amdahl's cruel law"). In addition, improvements in single-threaded performance benefit all applications, as each thread experiences a performance uplift, thus impacting all parts of the code-sequential and parallel.However, improving single-threaded performance is hard. The move to multicore was driven by the power limitations of complex out-of-order hardware schemes to extract ILP (caused by the failure of Dennard scaling in the underlying transistor technologies). While designers do still increase the out-of-order instruction window, unfortunately this only makes a marginal difference and future designs are expected to be limited by Pollack's rule and the fundamental limits of ILP (the ILP wall). Conversely, although many applications would see a major performance boost from taking advantage of TLP, actually extracting it remains a challenge (John Hennessy said writing parallel code is "a problem that's as hard as any that computer science has faced").This project takes a radically different approach. Instead of going back to the future with elaborate schemes for out-of-order execution, it explores the space between ILP and the coarse-grained TLP exploited by modern multicores. In particular, it focuses on the extraction of fine-grained TLP from a single stream of instructions within and across cores. On the one hand it will investigate schemes to identify and spin-up independent short-running threads (hardware threadlets) transparently to the application, so as to boost single-threaded performance. On the other, it will research compiler techniques to indicate this parallelism, with the hardware able to exploit it within and across multiple tightly coupled cores. If successful, this project would lead to a step change in performance of high-performance cores, driven by increased utilisation of core resources and the ability to increase those resources in a scalable manner. It would also open up a broader design space, trading out-of-order pipeline complexity for ILP with increased TLP, to find better balances between area, efficiency and application-domain suitability.