Fast shared-memory streaming multilevel graph partitioning

被引:12
|
作者
Jafari, Nazanin [1 ]
Selvitopi, Oguz [2 ]
Aykanat, Cevdet [3 ]
机构
[1] UMass Amherst, Coll Informat & Comp Sci, Amherst, MA 01002 USA
[2] Lawrence Berkeley Natl Lab, Computat Res Div, 1 Cyclotron Rd, Berkeley, CA 94720 USA
[3] Bilkent Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
关键词
Streaming algorithms; Graph partitioning; Multilevel graph partitioning; Parallel graph partitioning; PARALLEL; EIGENVECTORS; MATRICES;
D O I
10.1016/j.jpdc.2020.09.004
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A fast parallel graph partitioner can benefit many applications by reducing data transfers. The online methods for partitioning graphs have to be fast and they often rely on simple one-pass streaming algorithms, while the offline methods for partitioning graphs contain more involved algorithms and the most successful methods in this category belong to the multilevel approaches. In this work, we assess the feasibility of using streaming graph partitioning algorithms within the multilevel framework. Our end goal is to come up with a fast parallel offline multilevel partitioner that can produce competitive cutsize quality. We rely on a simple but fast and flexible streaming algorithm throughout the entire multilevel framework. This streaming algorithm serves multiple purposes in the partitioning process: a clustering algorithm in the coarsening, an effective algorithm for the initial partitioning, and a fast refinement algorithm in the uncoarsening. Its simple nature also lends itself easily for parallelization. The experiments on various graphs show that our approach is on the average up to 5.1x faster than the multi-threaded MeTiS, which comes at the expense of only 2x worse cutsize. Published by Elsevier Inc.
引用
收藏
页码:140 / 151
页数:12
相关论文
共 50 条
  • [31] SHARED-MEMORY AND MESSAGE QUEUES
    LAM, RB
    DR DOBBS JOURNAL, 1995, 20 (05): : 28 - &
  • [32] AND OR PARALLELISM ON SHARED-MEMORY MULTIPROCESSORS
    GUPTA, G
    JAYARAMAN, B
    JOURNAL OF LOGIC PROGRAMMING, 1993, 17 (01): : 59 - 89
  • [33] UNAMBIGUOUS SHARED-MEMORY SYSTEMS
    Morin, Remi
    INTERNATIONAL JOURNAL OF FOUNDATIONS OF COMPUTER SCIENCE, 2010, 21 (04) : 665 - 685
  • [34] ATOMIC SNAPSHOTS OF SHARED-MEMORY
    AFEK, Y
    ATTIYA, H
    DOLEV, D
    GAFNI, E
    MERRITT, M
    SHAVIT, N
    JOURNAL OF THE ACM, 1993, 40 (04) : 873 - 890
  • [35] Congra: Towards Efficient Processing of Concurrent Graph Queries on Shared-Memory Machines
    Pan, Peitian
    Li, Chao
    2017 IEEE 35TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), 2017, : 217 - 224
  • [36] Slicing Shared-Memory Concurrent Programs The Threaded System Dependence Graph Revisited
    Galindo, Carlos
    Llorens, Marisa
    Perez, Sergio
    Silva, Josep
    2023 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION, ICSME, 2023, : 73 - 83
  • [37] Understanding Priority-Based Scheduling of Graph Algorithms on a Shared-Memory Platform
    Yesil, Serif
    Heidarshenas, Azin
    Morrison, Adam
    Torrellas, Josep
    PROCEEDINGS OF SC19: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2019,
  • [38] MEMORY ACCESS DEPENDENCIES IN SHARED-MEMORY MULTIPROCESSORS
    DUBOIS, M
    SCHEURICH, C
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1990, 16 (06) : 660 - 673
  • [39] Memory latency in distributed shared-memory multiprocessors
    Motlagh, BS
    DeMara, RF
    PROCEEDINGS IEEE SOUTHEASTCON '98: ENGINEERING FOR A NEW ERA, 1998, : 134 - 137
  • [40] Incremental Streaming Graph Partitioning
    Durbeck, Lisa
    Athanas, Peter
    2020 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2020,