Implementation of a parallel graph partition algorithm to speed up BSP computing

被引：0
|
作者：
Luo, Shengmei [1 ]
Liu, Lixia [2 ]
Wang, Hongxu [3 ]
Wu, Bin [3 ]
Liu, Yang [3 ]
机构：
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[2] Zhongxing Telecom Equipment Corp, Nanjing 210012, Peoples R China
[3] Beijing Univ Posts & Telecommun, Beijing 100876, Peoples R China
来源：
2014 11TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD) | 2014年
关键词：
complex network; MapReduce; BSP; HAMA; graph partition;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The processing and mining information in large scale graph data have proven to be challenging. The bulk synchronous parallel (BSP) computing model is suitable for this task. In this paper, we implement the multi-level step-wise partitioning (MSP) algorithm in BSP programming model, and replace the original graph partition method. The results on both experimental data and real world data proved this improvement achieved better data locality, reduced communication between work nodes, and it made a better performance than the original method.
引用
收藏
页码：740 / 744
页数：5
相关论文
共 50 条
  • [1] A feasible graph partition framework for parallel computing of big graph
    Liu, X.
    Zhou, Y.
    Guan, X.
    Shen, C.
    [J]. KNOWLEDGE-BASED SYSTEMS, 2017, 134 : 228 - 239
  • [2] Efficient implementation of the BSP/CGM parallel vertex cover FPT algorithm
    Hanashiro, EJ
    Mongelli, H
    Song, SW
    [J]. EXPERIMENTAL AND EFFICIENT ALGORITHMS, 2004, 3059 : 253 - 268
  • [3] A Feasible Graph Partition Framework for Random Walks Implemented by Parallel Computing in Big Graph
    Liu Xiaoming
    Zhou Yadong
    Guan Xiaohong
    Sun Xiaoxiao
    [J]. 2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 4986 - 4991
  • [4] A Parallel and a Distributed Implementation of the Core Paths Graph Algorithm
    Pascarella, Domenico
    Venticinque, Salvatore
    Aversa, Rocco
    Mattei, Massimiliano
    Blasi, Luciano
    [J]. INTELLIGENT DISTRIBUTED COMPUTING VIII, 2015, 570 : 417 - 426
  • [5] A parallel algorithm for graph matching and its MasPar implementation
    Allen, R
    Cinque, L
    Tanimoto, S
    Shapiro, L
    Yasuda, D
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1997, 8 (05) : 490 - 501
  • [6] Implementation of parallel computing FAST algorithm on mobile GPU
    Chou, Chienhsing
    Liu, Peter
    Wu, Taiyi
    Chien, Yihsiang
    [J]. Journal of Computational Information Systems, 2013, 9 (17): : 6937 - 6944
  • [7] A PARALLEL ALGORITHM FOR COMPUTING FOURIER-TRANSFORMS ON THE STAR GRAPH
    FRAGOPOULOU, P
    AKL, SG
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1994, 5 (05) : 525 - 531
  • [8] Design and implementation of high speed parallel Gardner algorithm
    Hu, Wanru
    Wang, Zhugang
    Mei, Ruru
    Chen, Xuan
    Zhang, Ying
    [J]. Guofang Keji Daxue Xuebao/Journal of National University of Defense Technology, 2023, 45 (02): : 95 - 104
  • [9] COMPUTING THE PARTITION FUNCTION FOR GRAPH HOMOMORPHISMS
    Barvinok, Alexander
    Soberon, Pablo
    [J]. COMBINATORICA, 2017, 37 (04) : 633 - 650
  • [10] Portability, predictability and performance for parallel computing: BSP in practice
    Reed, J
    Parrott, K
    Lanfear, T
    [J]. CONCURRENCY-PRACTICE AND EXPERIENCE, 1996, 8 (10): : 799 - 812
12345