Fast GPU-Based Generation of Large Graph Networks From Degree Distributions

被引:0
|
作者
Alam, Maksudul [1 ]
Perumalla, Kalyan [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
来源
FRONTIERS IN BIG DATA | 2021年 / 4卷
关键词
SIMT architectures; graph generation; GPU (graphic processing unit); random network; large graph; POWER LAWS; TOLERANCE;
D O I
10.3389/fdata.2021.737963
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] A GPU-based DEM for modelling large scale powder compaction with wide size distributions
    He, Y.
    Evans, T. J.
    Yu, A. B.
    Yang, R. Y.
    POWDER TECHNOLOGY, 2018, 333 : 219 - 228
  • [22] INFINEL: An efficient GPU-based processing method for unpredictable large output graph queries
    Park, Sungwoo
    Oh, Seyeon
    Kim, Min-Soo
    PROCEEDINGS OF THE 29TH ACM SIGPLAN ANNUAL SYMPOSIUM ON PRINCIPLES AND PRACTICE OF PARALLEL PROGRAMMING, PPOPP 2024, 2024, : 147 - 159
  • [23] gSampler: General and Efficient GPU-based Graph Sampling for Graph Learning
    Gong, Ping
    Liu, Renjie
    Mao, Zunyao
    Cai, Zhenkun
    Yan, Xiao
    Li, Cheng
    Wang, Minjie
    Li, Zhuozhao
    PROCEEDINGS OF THE TWENTY-NINTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, SOSP 2023, 2023, : 562 - 578
  • [24] Efficient GPU-based Graph Cuts for Stereo Matching
    Choi, Young-kyu
    Park, In Kyu
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2013, : 642 - 648
  • [25] GPregel: A GPU-Based Parallel Graph Processing Model
    Lai, Siyan
    Lai, Guangda
    Shen, Guojun
    Jin, Jing
    Lin, Xiaola
    2015 IEEE 17TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2015 IEEE 7TH INTERNATIONAL SYMPOSIUM ON CYBERSPACE SAFETY AND SECURITY, AND 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS), 2015, : 254 - 259
  • [26] GPU-based leaves contour generation algorithm
    张景峤
    王廷婷
    Advances in Manufacturing, 2011, (05) : 375 - 380
  • [27] GPU-based parallelization for bubble mesh generation
    Van Quang Dinh
    Marechal, Yves
    COMPEL-THE INTERNATIONAL JOURNAL FOR COMPUTATION AND MATHEMATICS IN ELECTRICAL AND ELECTRONIC ENGINEERING, 2017, 36 (04) : 1184 - 1197
  • [28] GPU-based leaves contour generation algorithm
    张景峤
    王廷婷
    Journal of Shanghai University(English Edition), 2011, 15 (05) : 375 - 380
  • [29] GPU-Based Medical Visualization for Large Datasets
    Zou, Hue
    Lin, Fu
    Han, Jie
    Zhang, Wen
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2015, 5 (07) : 1467 - 1473
  • [30] A FAST GPU-BASED IMPLEMENTATION OF AN SUPERPOSITION/CONVOLUTION ALGORITHM
    Diez-Domingo, S.
    Reinado, D.
    Cortina, T.
    Cazorla, D.
    Sanchez, J. L.
    Alonso, S.
    Ricos, B.
    Gonzalez, R.
    RADIOTHERAPY AND ONCOLOGY, 2010, 96 : S479 - S480