Straggler-free Coding for Concurrent Matrix Multiplications
Straggler-free Coding for Concurrent Matrix Multiplications
复制标题
DOI：
10.1109/isit44484.2020.9174239
复制
发表时间：
2020-06
期刊：
影响因子：
--
通讯作者：
Pedro Soto;Jun Li
中科院分区：
文献类型：
--
作者：
Pedro Soto;Jun Li
Matrix multiplication is a fundamental building block in various distributed computing algorithms. In order to compute the multiplication of large matrices, it is common practice to distribute the computation into multiple tasks running on different nodes. In order to tolerate potential stragglers among such nodes, various coding schemes have been proposed which add additional coded tasks. However, most existing coding schemes for the matrix multiplication are constructed for only one matrix multiplication, while it is common to compute multiple matrix multiplications concurrently in large-scale distributed computing workloads. In this paper, we propose a novel coding framework where the results of multiple multiplications can be obtained within one job concurrently. Compared with running the multiplications separately with multiple jobs, our work demonstrates that the same number of stragglers can be tolerated with much fewer tasks.A full version of this paper is accessible at: https://users.cs.fiu.edu/~junli/papers/pedro-isit20-full.pdf
