The Sparse Abstract Machine
The Sparse Abstract Machine
复制标题
DOI:
10.1145/3582016.3582051
复制
发表时间:
2022-08
期刊:
影响因子:
--
通讯作者:
Olivia Hsu;Maxwell Strange;Jaeyeon Won;Ritvik Sharma;K. Olukotun;J. Emer;M. Horowitz;Fredrik Kjolstad
中科院分区:
文献类型:
--
作者:
Olivia Hsu;Maxwell Strange;Jaeyeon Won;Ritvik Sharma;K. Olukotun;J. Emer;M. Horowitz;Fredrik Kjolstad
We propose the Sparse Abstract Machine (SAM), an abstract machine model for targeting sparse tensor algebra to reconfigurable and fixed-function spatial dataflow accelerators. SAM defines a streaming dataflow abstraction with sparse primitives that encompass a large space of scheduled tensor algebra expressions. SAM dataflow graphs naturally separate tensor formats from algorithms and are expressive enough to incorporate arbitrary iteration orderings and many hardware-specific optimizations. We also present Custard, a compiler from a high-level language to SAM that demonstrates SAM's usefulness as an intermediate representation. We automatically bind from SAM to a streaming dataflow simulator. We evaluate the generality and extensibility of SAM, explore the performance space of sparse tensor algebra optimizations using SAM, and show SAM's ability to represent dataflow hardware.