PSPLPA: Probability and similarity based parallel label propagation algorithm on spark

PSPLPA: Probability and similarity based parallel label propagation algorithm on spark
复制标题

PSPLPA:spark 上基于概率和相似性的并行标签传播算法

DOI:
10.1016/j.physa.2018.02.130
复制
发表时间:
2018-08
期刊:
Physica A: Statistical Mechanics and Its Applications
影响因子:
--
通讯作者:
Al Rodhaan Mznah
Al Rodhaan Mznah
中科院分区:
其他
文献类型:
--
作者:
Ma Tinghuai;Yue Mingliang;Qu Jingjing;Tian Yuan;Al Dhelaan Abdullah;Al Rodhaan Mznah

文献摘要

参考文献

被引文献

相似文献

随着社会网络的快速发展,计算成本也在不断增加。现有的许多算法不适合大规模数据。Apache Spark是一个开源的集群计算框架,它使我们能够解决计算机集群中的社区检测问题。本文提出了一种新型的Spark标签传播算法,称为PSPLPA(基于概率和相似性的并行标签传播算法)。PSPLPA采用了一种新的标签更新策略,在标签传播过程中,在每次迭代的概率。首先,基于k-shell的权重计算被集成到标签初始化过程中。其次,提出了并行传播步骤,有效地利用标签概率。第三,通过自动标签选择和相似度计算,显著降低了标签更新的随机性。在人工和真实的社交网络上进行的实验表明,该算法具有良好的可扩展性和准确性。
With the rapid growth of social network, the cost of computation is increasing. Many existing algorithms are not suitable for the large-scale data. Apache Spark is an open-source cluster computing framework that empowers us to solve the problem of community detection in a cluster of computer. In this paper, we propose a novel label propagation algorithm on Spark, called PSPLPA (Probability and similarity based Parallel label propagation algorithm). PSPLPA employs a new label updating strategy using probability in the label propagation procedure during each iteration. First, weight calculation, which is based on k-shell, is integrated into the label initialization process. Second, parallel propagation steps are comprehensively proposed to utilize label probability efficiently. Third, randomness in label updating is significantly reduced via automatic label selection and similarity computation. Experiments conducted on artificial and real social networks demonstrate that the proposed algorithm exhibits high scalability and high accuracy.
识别全方位节点以在复杂网络中传播动态
DOI: 10.1016/j.physa.2012.02.033
发表时间: 2012-08-01
影响因子: 3.3
作者:
Hou, Bonan;Yao, Yiping;Liao, Dongsheng
通讯作者: Liao, Dongsheng
DOI: 10.1007/978-3-319-26181-2_33
发表时间: 2015-11
期刊: --
影响因子: --
作者:
Rongrong Li;Wenzhong Guo;Kun Guo;Qirong Qiu
通讯作者: Rongrong Li;Wenzhong Guo;Kun Guo;Qirong Qiu
DOI: 10.1103/physreve.76.036106
发表时间: 2007-09-01
期刊: PHYSICAL REVIEW E
影响因子: 2.4
作者:
Raghavan, Usha Nandini;Albert, Reka;Kumara, Soundar
通讯作者: Kumara, Soundar
DOI: 10.1109/socialcom.2013.37
发表时间: 2013-09
期刊: 2013 International Conference on Social Computing
影响因子: --
作者:
Konstantin Kuzmin;B. Szymański;Thesis Advisor;Mark K Goldberg;Sibel Adali
通讯作者: Konstantin Kuzmin;B. Szymański;Thesis Advisor;Mark K Goldberg;Sibel Adali
DOI: 10.1016/j.physa.2016.12.047
发表时间: 2017-04-01
影响因子: 3.3
作者:
Chen, Naiyue;Liu, Yun;Cheng, Junjun
通讯作者: Cheng, Junjun