HDRF: Stream-Based Partitioning for Power-Law Graphs
HDRF: Stream-Based Partitioning for Power-Law Graphs
复制标题
DOI:
10.1145/2806416.2806424
复制
发表时间:
2015-10
期刊:
影响因子:
--
通讯作者:
F. Petroni;Leonardo Querzoni;Khuzaima S. Daudjee;Shahin Kamali;Giorgio Iacoboni
中科院分区:
文献类型:
--
作者:
F. Petroni;Leonardo Querzoni;Khuzaima S. Daudjee;Shahin Kamali;Giorgio Iacoboni
Balanced graph partitioning is a fundamental problem that is receiving growing attention with the emergence of distributed graph-computing (DGC) frameworks. In these frameworks, the partitioning strategy plays an important role since it drives the communication cost and the workload balance among computing nodes, thereby affecting system performance. However, existing solutions only partially exploit a key characteristic of natural graphs commonly found in the real-world: their highly skewed power-law degree distributions. In this paper, we propose High-Degree (are) Replicated First (HDRF), a novel streaming vertex-cut graph partitioning algorithm that effectively exploits skewed degree distributions by explicitly taking into account vertex degree in the placement decision. We analytically and experimentally evaluate HDRF on both synthetic and real-world graphs and show that it outperforms all existing algorithms in partitioning quality.