SPX: Collaborative Research: Eat your Wheaties: Multi-Grain Compilers for Parallel Builds at Every Scale

SPX：协作研究：吃你的小麦：用于各种规模并行构建的多粒度编译器

• 批准号: 1725672
• 负责人: Milind Kulkarni
• 金额: $ 20万
• 依托单位: Purdue University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-08-15 至 2021-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1725672&HistoricalAwards=false
• 关键词: SPX; Collaborative; Research; Eat; your

Title: SPX: Collaborative Research: Multi-Grain Compilers for Parallel Builds at Every ScaleModern software development practices at companies such as Google and Facebook have led to compilation -- the process of transforming source programs into executable programs -- becoming a significant, time-consuming, resource-intensive process. Unfortunately, even state of the art compilers and build systems do not do a good job of exploiting emerging, high-performance, highly-parallel hardware, so software development is hampered by the still-slow process of compilation. This project aims to develop new techniques to speed up the process of compilation. The intellectual merits are designing new compiler internals, algorithms, and schedulers to enable compilers to take advantage of modern hardware capabilities. The project's broader significance and importance are that the process of compilation undergirds virtually every aspect of modern software, and hence modern life: speeding up compilation enables any type of software to be developed more quickly, providing new features to users and more quickly squashing potentially catastrophic bugs.The project revolves around three main thrusts. First, the PIs are developing new representations for compiler internals that better fit the memory hierarchy of modern machines, eschewing pointer-based representations for dense representations. We are designing techniques to allow programmers to write their compiler passes at a high level while automatically converting them to use the dense representation. Second, the PIs are designing new algorithms to optimize compiler passes. These are transformations of internal compiler algorithms to promote locality (by combining passes that operate on similar portions of a program) and to enhance parallelism (by eliminating unnecessary synchronization between passes). Finally, the PIs are creating new scheduling techniques to allow the new highly-parallel compiler algorithms to be effectively mapped to the parallel and distributed hardware on which modern build systems execute.

在b谷歌和Facebook等公司的现代软件开发实践中，编译（将源程序转换为可执行程序的过程）已经成为一个重要的、耗时的、资源密集型的过程。不幸的是，即使是最先进的编译器和构建系统也不能很好地利用新兴的、高性能的、高度并行的硬件，因此软件开发受到仍然缓慢的编译过程的阻碍。这个项目旨在开发新技术来加快编译过程。智力上的优点是设计新的编译器内部、算法和调度器，使编译器能够利用现代硬件功能。该项目更广泛的意义和重要性在于，编译过程实际上是现代软件和现代生活的每一个方面的基础：加速编译使任何类型的软件都能更快地开发出来，为用户提供新的特性，并更快地消除潜在的灾难性错误。该项目围绕三个主要目标展开。首先，pi正在为编译器内部开发新的表示，以更好地适应现代机器的内存层次结构，避免基于指针的表示，采用密集的表示。我们正在设计一些技术，允许程序员在高层次上编写编译器传递，同时自动将它们转换为使用密集表示。其次，pi正在设计新的算法来优化编译程序。这些是内部编译器算法的转换，以提高局部性（通过组合在程序的相似部分上操作的传递）和增强并行性（通过消除传递之间不必要的同步）。最后，pi正在创建新的调度技术，以允许新的高度并行编译器算法有效地映射到执行现代构建系统的并行和分布式硬件上。

项目成果

Sound, fine-grained traversal fusion for heterogeneous trees

针对异构树的健全、细粒度的遍历融合

• DOI: 10.1145/3314221.3314626
• 发表时间: 2019
• 期刊: 40th ACM SIGPLAN Conference on Programming Language Design and Implementation
• 作者: Sakka, Laith;Sundararajah, Kirshanthan;Newton, Ryan R.;Kulkarni, Milind
• 通讯作者: Kulkarni, Milind

Efficient tree-traversals: reconciling parallelism and dense data representations

高效的树遍历：协调并行性和密集数据表示

• DOI: 10.1145/3473596
• 发表时间: 2021
• 期刊: Proceedings of the ACM on Programming Languages
• 作者: Koparkar, Chaitanya;Rainey, Mike;Vollmer, Michael;Kulkarni, Milind;Newton, Ryan R.
• 通讯作者: Newton, Ryan R.

Composable, sound transformations of nested recursion and loops

嵌套递归和循环的可组合、健全的转换

• DOI: 10.1145/3314221.3314592
• 发表时间: 2019
• 期刊: 40th ACM SIGPLAN Conference on Programming Language Design and Implementation
• 作者: Sundararajah, Kirshanthan;Kulkarni, Milind
• 通讯作者: Kulkarni, Milind

Vectorized secure evaluation of decision forests

决策森林的矢量化安全评估

• DOI: 10.1145/3453483.3454094
• 发表时间: 2021
• 期刊: PLDI 2021: Proceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation
• 作者: Malik, Raghav;Singhal, Vidush;Gottfried, Benjamin;Kulkarni, Milind
• 通讯作者: Kulkarni, Milind

LoCal: a language for programs operating on serialized data

LoCal：一种用于操作序列化数据的程序的语言

• DOI: 10.1145/3314221.3314631
• 发表时间: 2019
• 期刊: 40th ACM SIGPLAN Conference on Programming Language Design and Implementation
• 作者: Vollmer, Michael;Koparkar, Chaitanya;Rainey, Mike;Sakka, Laith;Kulkarni, Milind;Newton, Ryan R.
• 通讯作者: Newton, Ryan R.