Parallelizing Sequential Graph Computations

被引:27
|
作者
Fan, Wenfei [1 ,2 ,3 ]
Yu, Wenyuan [4 ]
Xu, Jingbo [4 ]
Zhou, Jingren [4 ]
Luo, Xiaojian [4 ]
Yin, Qiang [2 ,4 ]
Lu, Ping [5 ]
Cao, Yang [1 ]
Xu, Ruiqi [1 ]
机构
[1] Univ Edinburgh, 10 Crichton St, Edinburgh EH8 9AB, Midlothian, Scotland
[2] Beihang Univ, 37 Xue Yuan Rd, Beijing 100191, Peoples R China
[3] Shenzhen Inst Comp Sci, Shenzhen, Peoples R China
[4] Alibaba Grp, 969 West Wen Yi Rd, Hangzhou 311121, Zhejiang, Peoples R China
[5] Beihang Univ, BDBC, 37 Xue Yuan Rd, Beijing 100191, Peoples R China
来源
ACM TRANSACTIONS ON DATABASE SYSTEMS | 2018年 / 43卷 / 04期
基金
英国工程与自然科学研究理事会; 欧洲研究理事会;
关键词
Graph computations; parallel graph query engines; parallelizing sequential algorithms; convergence; simulation; CONVERGENCE; MODEL;
D O I
10.1145/3282488
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article presents GRAPE, a parallel (GRAPh) under bar (E) under bar ngine for graph computations. GRAPE differs from prior systems in its ability to parallelize existing sequential graph algorithms as a whole, without the need for recasting the entire algorithm into a new model. Underlying GRAPE are a simple programming model and a principled approach based on fixpoint computation that starts with partial evaluation and uses an incremental function as the intermediate consequence operator. We show that users can devise existing sequential graph algorithms with minor additions, and GRAPE parallelizes the computation. Under a monotonic condition, the GRAPE parallelization guarantees to converge at correct answers as long as the sequential algorithms are correct. Moreover, we show that algorithms in MapReduce, BSP, and PRAM can be optimally simulated on GRAPE. In addition to the ease of programming, we experimentally verify that GRAPE achieves comparable performance to the state-of-the-art graph systems using real-life and synthetic graphs.
引用
收藏
页数:39
相关论文
共 50 条
  • [21] Parallel computations on a graph
    I. B. Bourdonov
    A. S. Kossatchev
    V. V. Kulyamin
    Programming and Computer Software, 2015, 41 : 1 - 13
  • [22] An Improved Algorithm for Parallelizing Sequential Minimal Optimization
    Li, C. R.
    Guo, J.
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY AND MANAGEMENT SCIENCE (ITMS 2015), 2015, 34 : 1352 - 1355
  • [23] Parallel computations on a graph
    Bourdonov, I. B.
    Kossatchev, A. S.
    Kulyamin, V. V.
    PROGRAMMING AND COMPUTER SOFTWARE, 2015, 41 (01) : 1 - 13
  • [24] Case study: Parallelizing a sequential simulation model
    Bajaj, L
    Bagrodia, R
    Meyer, R
    THIRTEENTH WORKSHOP ON PARALLEL AND DISTRIBUTED SIMULATION - PROCEEDINGS, 1999, : 29 - 36
  • [25] Graph homology computations
    Brun, Simon
    Willwacher, Thomas
    NEW YORK JOURNAL OF MATHEMATICS, 2024, 30 : 58 - 92
  • [26] PATH LENGTH COMPUTATIONS ON GRAPH MODELS OF COMPUTATIONS
    MARTIN, DF
    ESTRIN, G
    IEEE TRANSACTIONS ON COMPUTERS, 1969, C 18 (06) : 530 - &
  • [27] Parallelizing an Algorithm to decide if a Bipartite Graph is Shellable
    Galvis, Andres
    Cruz, Roberto
    Trefftz, Christian
    Branch, John W.
    2013 IEEE INTERNATIONAL CONFERENCE ON ELECTRO-INFORMATION TECHNOLOGY (EIT 2013), 2013,
  • [28] Graph partitioning for scalable distributed graph computations
    Buluc, Aydin
    Madduri, Kamesh
    GRAPH PARTITIONING AND GRAPH CLUSTERING, 2013, 588 : 83 - +
  • [29] A lock-free approach to parallelizing personalized PageRank computations on GPU
    Wang, Zhigang
    Wang, Ning
    Nie, Jie
    Wei, Zhiqiang
    Gu, Yu
    Yu, Ge
    FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (01)
  • [30] Parallelizing Dynamic Time Warping Algorithm Using Prefix Computations on GPU
    Xiao, Limin
    Zheng, Yao
    Tang, Wenqi
    Yao, Guangchao
    Ruan, Li
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 294 - 299