A Review: Scalable Parallel Graph Partitioning For Complex Networks

被引:0
|
作者
Mokashi, V. S. [1 ]
Kulkarni, D. B. [1 ]
机构
[1] Walchand Coll Engn, Dept Informat Technol, Sangli, India
关键词
Graph Partitioning; graph clustering; Label propagation; community detection; Complex networks;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
partitioning graphs at extent is a critical contest for several solicitations that incorporate provision a graph transversely disk, technologies, or data centers. Graph partitioning is an exact fine, considered difficult with satirical collected works, but surviving algorithms classically cannot measure to billions of edges, or cannot deliver assurances about partition bulks. In this work, we announce an effective algorithm, composed label propagation, for exactly partitioning immense graphs while hungrily exploiting edge vicinity, the expanse of edges that are allocated to the equal sliver of a partition. By merging the computational competence of label propagation where nodes are iteratively relabeled to the similar 'label' as the variety of their graph neighbors' - with the assurances of inhibited optimization - managing the propagation by an undeviating platform obliging the partition scopes - our algorithm types it virtually imaginable to divide graphs with billions of edges. Our algorithm is attracted by the competition of finishing Graph assessments in a detached structure. Because this requires conveying each node in a graph to a physical machine with memory boundaries, it is disapprovingly essential to guarantee the resultant partition debris do not exceed several single machines. We estimate our algorithm for its dividing performance on the social graph, and also learning its enactment when dividing Facebook's 'People You May Know' service (PYMK), the dispersed scheme answerable for the article abstraction and the standing of the friends-of-friends of all vigorous Facebook users. In a live placement, we observed typical interrogation times and average network circulation stages that were 50.5% and 37.1% (respectively) when matched to the earlier naive random sharding.
引用
收藏
页码:1869 / 1871
页数:3
相关论文
共 50 条
  • [1] Parallel Graph Partitioning for Complex Networks
    Meyerhenke, Henning
    Sanders, Peter
    Schulz, Christian
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (09) : 2625 - 2638
  • [2] Parallel Graph Partitioning for Complex Networks
    Meyerhenke, Henning
    Sanders, Peter
    Schulz, Christian
    [J]. 2015 IEEE 29TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2015, : 1055 - 1064
  • [3] Scalable Parallel Graph Partitioning
    Kirmani, Shad
    Raghavan, Padma
    [J]. 2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC), 2013,
  • [4] Graph partitioning for scalable distributed graph computations
    Buluc, Aydin
    Madduri, Kamesh
    [J]. GRAPH PARTITIONING AND GRAPH CLUSTERING, 2013, 588 : 83 - +
  • [5] Scalable, Multi-Constraint, Complex-Objective Graph Partitioning
    Slota, George M.
    Root, Cameron
    Devine, Karen
    Madduri, Kamesh
    Rajamanickam, Sivasankaran
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (12) : 2789 - 2801
  • [6] Scalable Data Parallel Distributed Training for Graph Neural Networks
    Koyama, Sohei
    Tatebe, Osamu
    [J]. 2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2022), 2022, : 699 - 707
  • [7] Spinner: Scalable Graph Partitioning in the Cloud
    Martella, Claudio
    Logothetis, Dionysios
    Loukas, Andreas
    Siganos, Georgos
    [J]. 2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2017), 2017, : 1083 - 1094
  • [8] Graph partitioning and parallel computing
    Biswas, R
    Hendrickson, B
    Karypis, G
    [J]. PARALLEL COMPUTING, 2000, 26 (12) : 1515 - 1517
  • [9] Parallel multilevel graph partitioning
    Karypis, G
    Kumar, V
    [J]. 10TH INTERNATIONAL PARALLEL PROCESSING SYMPOSIUM - PROCEEDINGS OF IPPS '96, 1996, : 314 - 319
  • [10] Parallel incremental graph partitioning
    Ou, CW
    Ranka, S
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1997, 8 (08) : 884 - 896