Fast GPU-Based Generation of Large Graph Networks From Degree Distributions

被引:0
|
作者
Alam, Maksudul [1 ]
Perumalla, Kalyan [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
来源
FRONTIERS IN BIG DATA | 2021年 / 4卷
关键词
SIMT architectures; graph generation; GPU (graphic processing unit); random network; large graph; POWER LAWS; TOLERANCE;
D O I
10.3389/fdata.2021.737963
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] A GPU-based solution for fast calculation of the betweenness centrality in large weighted networks
    Fan, Rui
    Xu, Ke
    Zhao, Jichang
    PEERJ COMPUTER SCIENCE, 2017,
  • [2] A GPU-based algorithm for fast node label learning in large and unbalanced biomolecular networks
    Marco Frasca
    Giuliano Grossi
    Jessica Gliozzo
    Marco Mesiti
    Marco Notaro
    Paolo Perlasca
    Alessandro Petrini
    Giorgio Valentini
    BMC Bioinformatics, 19
  • [3] A GPU-based algorithm for fast node label learning in large and unbalanced biomolecular networks
    Frasca, Marco
    Grossi, Giuliano
    Gliozzo, Jessica
    Mesiti, Marco
    Notaro, Marco
    Perlasca, Paolo
    Petrini, Alessandro
    Valentini, Giorgio
    BMC BIOINFORMATICS, 2018, 19 : 269 - 280
  • [4] Fast GPU-based normal map generation for simplified models
    Gumbau, Jesus
    Gonzalez, Carlos
    Chover, Miguel
    WSCG 2006: POSTERS PROCEEDINGS: 14TH INTERNATIONAL CONFERENCE IN CENTRAL EUROPE ON COMPUTER GRAPHICS, VISUALIZATION AND COMPUTER VISION 2006, 2006, : 15 - 16
  • [5] GPU-based fast ray casting for a large number of metaballs
    Kanamori, Yoshihiro
    Szego, Zoltan
    Nishita, Tomoyuki
    COMPUTER GRAPHICS FORUM, 2008, 27 (02) : 351 - 360
  • [6] GPU-based, interactive exploration of large spatiotemporal climate networks
    Buschmann, Stefan
    Hoffmann, Peter
    Agarwal, Ankit
    Marwan, Norbert
    Nocke, Thomas
    CHAOS, 2023, 33 (04)
  • [7] A GPU-based Graph Pattern Mining System
    Hu, Lin
    Zou, Lei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4867 - 4871
  • [8] GPU-based normal map generation
    Gumbau, Jesus
    Gonzalez, Carlos
    Chover, Miguel
    GRAPP 2008: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2008, : 62 - 67
  • [9] GPU-based Graph Traversal on Compressed Graphs
    Sha, Mo
    Li, Yuchen
    Tan, Kian-Lee
    SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2019, : 775 - 792
  • [10] Optimization of GPU-based Sparse Matrix Multiplication for Large Sparse Networks
    Lee, Jeongmyung
    Kang, Seokwon
    Yu, Yongseung
    Jo, Yong-Yeon
    Kim, Sang-Wook
    Park, Yongjun
    2020 IEEE 36TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2020), 2020, : 925 - 936