Optimizing Parallel Graph Connectivity Computation via Subgraph Sampling

被引:28
|
作者
Sutton, Michael [1 ]
Ben-Nun, Tal [2 ]
Barak, Amnon [1 ]
机构
[1] Hebrew Univ Jerusalem, Dept Comp Sci, IL-91904 Jerusalem, Israel
[2] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
关键词
Connected Components; Parallel Algorithms; Graph Algorithms;
D O I
10.1109/IPDPS.2018.00012
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Connected component identification is a fundamental problem in graph analytics, serving as a basis for subsequent computations in a wide range of applications. To determine connectivity, several parallel algorithms, whose complexity is proportional to the number of edges or graph diameter, have been proposed. However, an optimal algorithm may extract graph components by working proportionally to the number of vertices, which can be orders of magnitude lower than the number of edges. We propose Afforest: an extension of the Shiloach-Vishkin connected components algorithm that approaches optimal work efficiency by processing subgraphs in each iteration. We prove the convergence of the algorithm, analyze its work efficiency characteristics, and provide further techniques to speed up processing graphs containing a huge component. Designed with modern parallel architectures in mind, we show that the algorithm exhibits higher memory locality than existing methods. Using both synthetic and real-world graphs, we demonstrate that Afforest achieves speedups of up to 67x over the state-of-the-art on multi-core CPUs (Broadwell, POWER8) and up to 23x on GPUs (Pascal).
引用
收藏
页码:12 / 21
页数:10
相关论文
共 50 条
  • [1] PARALLEL COMPUTATION OF THE EULER NUMBER VIA CONNECTIVITY GRAPH
    CHIAVETTA, F
    DIGESU, V
    [J]. PATTERN RECOGNITION LETTERS, 1993, 14 (11) : 849 - 859
  • [2] Estimating the number of connected components in a graph via subgraph sampling
    Klusowski, Jason M.
    Wu, Yihong
    [J]. BERNOULLI, 2020, 26 (03) : 1635 - 1664
  • [3] CONNECTIVITY, GRAPH MINORS, AND SUBGRAPH MULTIPLICITY
    EPPSTEIN, D
    [J]. JOURNAL OF GRAPH THEORY, 1993, 17 (03) : 409 - 416
  • [4] Parallel Training via Computation Graph Transformation
    Wang, Fei
    Chen, Guoyang
    Zhang, Weifeng
    Rompf, Tiark
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 3430 - 3439
  • [5] GraSP: Optimizing Graph-based Nearest Neighbor Search with Subgraph Sampling and Pruning
    Zhang, Minjia
    Wang, Wenhan
    He, Yuxiong
    [J]. WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 1395 - 1405
  • [6] THE PARALLEL COMPLEXITY OF THE SUBGRAPH CONNECTIVITY PROBLEM
    KIROUSIS, L
    SERNA, M
    SPIRAKIS, P
    [J]. 30TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, 1989, : 294 - 299
  • [7] More Interpretable Graph Similarity Computation Via Maximum Common Subgraph Inference
    Lan Z.
    Hong B.
    Ma Y.
    Ma F.
    [J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (11) : 1 - 12
  • [8] Knowledge Graph Reasoning via Dynamic Subgraph Attention with Low Resource Computation
    Wang, Yin
    Xia, Nan
    Yu, Hang
    Luo, Xiangfeng
    [J]. NEUROCOMPUTING, 2024, 595
  • [9] KGEx: Explaining Knowledge Graph Embeddings via Subgraph Sampling and Knowledge Distillation
    Baltatzis, Vasileios
    Costabello, Luca
    [J]. LEARNING ON GRAPHS CONFERENCE, VOL 231, 2023, 231
  • [10] AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution
    Zhao, Yuxuan
    Sun, Qi
    He, Zhuolun
    Bai, Yang
    Yu, Bei
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11354 - 11362