Fast GPU-Based Generation of Large Graph Networks From Degree Distributions

被引:0
|
作者
Alam, Maksudul [1 ]
Perumalla, Kalyan [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
来源
FRONTIERS IN BIG DATA | 2021年 / 4卷
关键词
SIMT architectures; graph generation; GPU (graphic processing unit); random network; large graph; POWER LAWS; TOLERANCE;
D O I
10.3389/fdata.2021.737963
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] GMiner: A fast GPU-based frequent itemset mining method for large-scale data
    Chon, Kang-Wook
    Hwang, Sang-Hyun
    Kim, Min-Soo
    INFORMATION SCIENCES, 2018, 439 : 19 - 38
  • [42] Large steps in GPU-based deformable bodies simulation
    Tejada, E
    Ertl, T
    SIMULATION MODELLING PRACTICE AND THEORY, 2005, 13 (08) : 703 - 715
  • [43] GPU-Based Large-Scale Scientific Visualization
    Beyer, Johanna
    Hadwiger, Markus
    SA'18: SIGGRAPH ASIA 2018 COURSES, 2018,
  • [44] Performance Analysis of GPU-based Convolutional Neural Networks
    Li, Xiaqing
    Zhang, Guangyan
    Huang, H. Howie
    Wang, Zhufan
    Zheng, Weimin
    PROCEEDINGS 45TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING - ICPP 2016, 2016, : 67 - 76
  • [45] GPU-Based Large Seismic Data Parallel Compression
    Xie, Kai
    Yu, H. Q.
    Lu, G. Y.
    INTELLIGENCE COMPUTATION AND EVOLUTIONARY COMPUTATION, 2013, 180 : 339 - 345
  • [46] Performance and Scalability of GPU-based Convolutional Neural Networks
    Strigl, Daniel
    Kofler, Klaus
    Podlipnig, Stefan
    PROCEEDINGS OF THE 18TH EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING, 2010, : 317 - 324
  • [47] Radial Basis Function Networks GPU-Based Implementation
    Brandstetter, Andreas
    Artusi, Alessandro
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (12): : 2150 - 2154
  • [48] Fast GPU-based denoising filter using isoline levels
    Gilles Perrot
    Stéphane Domas
    Raphaël Couturier
    Nicolas Bertaux
    Journal of Real-Time Image Processing, 2016, 12 : 31 - 42
  • [49] Very Fast Ellipse Detection using GPU-Based RHT
    Lee, Jong Kwan
    Wood, Brian A.
    Newman, Timothy S.
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 3165 - 3168
  • [50] Efficient GPU-based Large MIMO Detection Algorithm for Next-Generation Communication Systems
    Dabah, A.
    Rezki, Z.
    Ltaief, H.
    Keyes, D.
    Alouini, M. -S.
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 3372 - 3377