Fast GPU-Based Generation of Large Graph Networks From Degree Distributions

被引:0
|
作者
Alam, Maksudul [1 ]
Perumalla, Kalyan [1 ]
机构
[1] Oak Ridge Natl Lab, Comp Sci & Math Div, Oak Ridge, TN 37830 USA
来源
FRONTIERS IN BIG DATA | 2021年 / 4卷
关键词
SIMT architectures; graph generation; GPU (graphic processing unit); random network; large graph; POWER LAWS; TOLERANCE;
D O I
10.3389/fdata.2021.737963
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] A fast GPU-based hybrid algorithm for addition chains
    Bahig, Hatem M.
    AbdElbari, Khaled A.
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2018, 21 (04): : 2001 - 2011
  • [32] Fast GPU-Based Fluid Simulations Using SPH
    Krog, Oystein E.
    Elster, Anne C.
    APPLIED PARALLEL AND SCIENTIFIC COMPUTING, PT II, 2012, 7134 : 98 - 109
  • [33] Very Fast GPU-Based IMPT Dose Computation
    Sullivan, A.
    Brand, M.
    MEDICAL PHYSICS, 2015, 42 (06) : 3523 - 3523
  • [34] NUFFT- & GPU-Based Fast Imaging of Vegetation
    Capozzoli, Amedeo
    Curcio, Claudio
    Di Vico, Antonio
    Liseno, Angelo
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2011, E94B (07) : 2092 - 2103
  • [35] A fast GPU-based hybrid algorithm for addition chains
    Hatem M. Bahig
    Khaled A. AbdElbari
    Cluster Computing, 2018, 21 : 2001 - 2011
  • [36] A Fast and Generic GPU-Based Parallel Reduction Implementation
    Rfaei Jradi, Walid Abdala
    Dantas do Nascimento, Hugo Alexandre
    Martins, Wellington Santos
    2018 SYMPOSIUM ON HIGH PERFORMANCE COMPUTING SYSTEMS (WSCAD 2018), 2018, : 16 - 22
  • [37] EGraph: Efficient Concurrent GPU-Based Dynamic Graph Processing
    Zhang, Yu
    Liang, Yuxuan
    Zhao, Jin
    Mao, Fubing
    Gu, Lin
    Liao, Xiaofei
    Jin, Hai
    Liu, Haikun
    Guo, Song
    Zeng, Yangqing
    Hu, Hang
    Li, Chen
    Zhang, Ji
    Wang, Biao
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (06) : 5823 - 5836
  • [38] GPU-Based Supervoxel Generation With a Novel Anisotropic Metric
    Dong, Xiao
    Chen, Zhonggui
    Liu, Yong-Jin
    Yao, Junfeng
    Guo, Xiaohu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8847 - 8860
  • [39] GPU-Based Shape from Silhouettes
    Yous, Sofiane
    Laga, Hamid
    Kidode, Masatsugu
    Chihara, Kunihiro
    GRAPHITE 2007: 5TH INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES IN AUSTRALASIA AND SOUTHERN ASIA, PROCEEDINGS, 2007, : 71 - +
  • [40] A GPU-based WFST Decoder with Exact Lattice Generation
    Chen, Zhehuai
    Luitjens, Justin
    Xu, Hainan
    Wang, Yiming
    Povey, Daniel
    Khudanpur, Sanjeev
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 2212 - 2216