T-thinker: a task-centric distributed framework for compute-intensive divide-and-conquer algorithms
T-thinker: a task-centric distributed framework for compute-intensive divide-and-conquer algorithms
复制标题
T-thinker:用于计算密集型分而治之算法的以任务为中心的分布式框架
DOI:
10.1145/3293883.3295709
复制
发表时间:
2019
期刊:
影响因子:
--
通讯作者:
Tan, Weida
中科院分区:
文献类型:
--
作者:
Yan, Da;Guo, Guimu;Chowdhury, Md Mashiur;Özsu, M. Tamer;Lui, John C.;Tan, Weida
Many computationally expensive problems are solved by a divide-and-conquer algorithm: a problem over a big dataset can be recursively divided into independent tasks over smaller subsets of the dataset. We present a distributed general-purpose framework called T-thinker which effectively utilizes the CPU cores in a cluster by properly decomposing an expensive problem into smaller independent tasks for parallel computation. T-thinker well overlaps CPU processing with network communication, and its superior performance is verified over a re-engineered graph mining system G-thinker available at http://cs.uab.edu/yanda/gthinker/.