SPX: Collaborative Research: Eat your Wheaties: Multi-Grain Compilers for Parallel Builds at Every Scale

职务名称：SPX：合作研究：在Google和Facebook等公司的现代软件开发实践中，编译（将源程序转换为可执行程序的过程）已经成为一个重要的、耗时的、资源密集型的过程。 不幸的是，即使是最先进的编译器和构建系统也不能很好地利用新兴的、高性能的、高度并行的硬件，因此软件开发受到仍然缓慢的编译过程的阻碍。 该项目旨在开发新技术以加快汇编过程。智力上的优点是设计新的编译器内部结构、算法和编译器，使编译器能够利用现代硬件功能。该项目更广泛的意义和重要性在于编译过程实际上支撑着现代软件的各个方面，因此也是现代生活的基础：加速编译可以使任何类型的软件更快地开发，为用户提供新功能，并更快地压制潜在的灾难性错误。该项目围绕三个主要目标。首先，PI正在为编译器内部开发新的表示法，以更好地适应现代机器的内存层次结构，避开基于指针的表示法，以实现密集表示法。我们正在设计技术，允许程序员编写他们的编译器通过在一个高层次上，同时自动转换它们使用密集表示。其次，PI正在设计新的算法来优化编译器通道。这些是内部编译器算法的转换，以促进局部性（通过组合在程序的类似部分上操作的通道）和增强并行性（通过消除通道之间不必要的同步）。最后，PI正在创建新的调度技术，以允许新的高度并行编译器算法有效地映射到现代构建系统执行的并行和分布式硬件。

Title: SPX: Collaborative Research: Multi-Grain Compilers for Parallel Builds at Every ScaleModern software development practices at companies such as Google and Facebook have led to compilation -- the process of transforming source programs into executable programs -- becoming a significant, time-consuming, resource-intensive process. Unfortunately, even state of the art compilers and build systems do not do a good job of exploiting emerging, high-performance, highly-parallel hardware, so software development is hampered by the still-slow process of compilation. This project aims to develop new techniques to speed up the process of compilation. The intellectual merits are designing new compiler internals, algorithms, and schedulers to enable compilers to take advantage of modern hardware capabilities. The project's broader significance and importance are that the process of compilation undergirds virtually every aspect of modern software, and hence modern life: speeding up compilation enables any type of software to be developed more quickly, providing new features to users and more quickly squashing potentially catastrophic bugs.The project revolves around three main thrusts. First, the PIs are developing new representations for compiler internals that better fit the memory hierarchy of modern machines, eschewing pointer-based representations for dense representations. We are designing techniques to allow programmers to write their compiler passes at a high level while automatically converting them to use the dense representation. Second, the PIs are designing new algorithms to optimize compiler passes. These are transformations of internal compiler algorithms to promote locality (by combining passes that operate on similar portions of a program) and to enhance parallelism (by eliminating unnecessary synchronization between passes). Finally, the PIs are creating new scheduling techniques to allow the new highly-parallel compiler algorithms to be effectively mapped to the parallel and distributed hardware on which modern build systems execute.