Fast shared-memory streaming multilevel graph partitioning

被引:12
|
作者
Jafari, Nazanin [1 ]
Selvitopi, Oguz [2 ]
Aykanat, Cevdet [3 ]
机构
[1] UMass Amherst, Coll Informat & Comp Sci, Amherst, MA 01002 USA
[2] Lawrence Berkeley Natl Lab, Computat Res Div, 1 Cyclotron Rd, Berkeley, CA 94720 USA
[3] Bilkent Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
关键词
Streaming algorithms; Graph partitioning; Multilevel graph partitioning; Parallel graph partitioning; PARALLEL; EIGENVECTORS; MATRICES;
D O I
10.1016/j.jpdc.2020.09.004
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A fast parallel graph partitioner can benefit many applications by reducing data transfers. The online methods for partitioning graphs have to be fast and they often rely on simple one-pass streaming algorithms, while the offline methods for partitioning graphs contain more involved algorithms and the most successful methods in this category belong to the multilevel approaches. In this work, we assess the feasibility of using streaming graph partitioning algorithms within the multilevel framework. Our end goal is to come up with a fast parallel offline multilevel partitioner that can produce competitive cutsize quality. We rely on a simple but fast and flexible streaming algorithm throughout the entire multilevel framework. This streaming algorithm serves multiple purposes in the partitioning process: a clustering algorithm in the coarsening, an effective algorithm for the initial partitioning, and a fast refinement algorithm in the uncoarsening. Its simple nature also lends itself easily for parallelization. The experiments on various graphs show that our approach is on the average up to 5.1x faster than the multi-threaded MeTiS, which comes at the expense of only 2x worse cutsize. Published by Elsevier Inc.
引用
收藏
页码:140 / 151
页数:12
相关论文
共 50 条
  • [1] High-Quality Shared-Memory Graph Partitioning
    Akhremtsev, Yaroslav
    Sanders, Peter
    Schulz, Christian
    EURO-PAR 2018: PARALLEL PROCESSING, 2018, 11014 : 659 - 671
  • [2] High-Quality Shared-Memory Graph Partitioning
    Akhremtsev, Yaroslav
    Sanders, Peter
    Schulz, Christian
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (11) : 2710 - 2722
  • [3] Recursive Multi-Section on the Fly: Shared-Memory Streaming Algorithms for Hierarchical Graph Partitioning and Process Mapping
    Faraj, Marcelo Fonseca
    Schulz, Christian
    2022 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2022), 2022, : 473 - 483
  • [4] Scalable Shared-Memory Hypergraph Partitioning
    Gottesbueren, Lars
    Heuer, Tobias
    Sanders, Peter
    Schlag, Sebastian
    2021 PROCEEDINGS OF THE SYMPOSIUM ON ALGORITHM ENGINEERING AND EXPERIMENTS, ALENEX, 2021, : 16 - 30
  • [5] Shared-memory Graph Truss Decomposition
    Kabir, Humayun
    Madduri, Kamesh
    2017 IEEE 24TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING (HIPC), 2017, : 13 - 22
  • [6] Fast Parallel Graph Triad Census and Triangle Counting on Shared-memory Platforms
    Parimalarangan, Sindhuja
    Slota, George M.
    Madduri, Kamesh
    2017 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2017, : 1500 - 1509
  • [7] Shared-Memory n-level Hypergraph Partitioning
    Gottesbueren, Lars
    Heuer, Tobias
    Sanders, Peter
    Schlag, Sebastian
    2022 PROCEEDINGS OF THE SYMPOSIUM ON ALGORITHM ENGINEERING AND EXPERIMENTS, ALENEX, 2022, : 131 - 144
  • [8] Evaluation of Parallel Sparse Matrix Partitioning Software for Parallel Multilevel ILU Preconditioning on Shared-Memory Multiprocessors
    Aliaga, Jose I.
    Bollhoefer, Matthias
    Martin, Alberto F.
    Quintana-Orti, Enrique S.
    PARALLEL COMPUTING: FROM MULTICORES AND GPU'S TO PETASCALE, 2010, 19 : 125 - 132
  • [9] An Unequal Caching Strategy for Shared-Memory Graph Analytics
    Chen, YuAng
    Chung, Yeh-Ching
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (03) : 955 - 967
  • [10] Efficient shared-memory support for parallel graph reduction
    Bennett, AJ
    Kelly, PHJ
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 1997, 12 (06): : 481 - 503