An investigation of big graph partitioning methods for distribution of graphs in vertex-centric systems

被引:0
|
作者
Nasrin Mazaheri Soudani
Afsaneh Fatemi
Mohammadali Nematbakhsh
机构
[1] University of Isfahan,Department of Computer Engineering
来源
关键词
Graph partitioning; Vertex-centric systems; Big graphs; Distributed computing;
D O I
暂无
中图分类号
学科分类号
摘要
Relations among data entities in most big data sets can be modeled by a big graph. Implementation and execution of algorithms related to the structure of big graphs is very important in different fields. Because of the inherently high volume of big graphs, their calculations should be performed in a distributed manner. Some distributed systems based on vertex-centric model have been introduced for big graph calculations in recent years. The performance of these systems in terms of run time depends on the partitioning and distribution of the graph. Therefore, the graph partitioning is a major concern in this field. This paper concentrates on big graph partitioning approaches for distribution of graphs in vertex-centric systems. This briefly discusses vertex-centric systems and formulates different models of graph partitioning problem. Then, a review of recent methods of big graph partitioning for these systems is shown. Most recent methods of big graph partitioning for vertex centric systems can be categorized into three classes: (i) stream-based methods that see vertices or edges of the graph in a stream and partition them, (ii) distributed methods that partition vertices or edges in a distributed manner, and (iii) dynamic methods that change partitions during the execution of algorithms to obtain better performance. This study compares the properties of different approaches in each class and briefly reviews methods that are not in these categories. This comparison indicates that The streaming methods are good choices for initial load of the graph in Vertex-centric systems. The distributed and dynamic methods are appropriate for long-running applications.
引用
收藏
页码:1 / 29
页数:28
相关论文
共 50 条
  • [1] An investigation of big graph partitioning methods for distribution of graphs in vertex-centric systems
    Mazaheri Soudani, Nasrin
    Fatemi, Afsaneh
    Nematbakhsh, Mohammadali
    DISTRIBUTED AND PARALLEL DATABASES, 2020, 38 (01) : 1 - 29
  • [2] Revolver: Vertex-centric Graph Partitioning Using Reinforcement Learning
    Mofrad, Mohammad Hasanzadeh
    Melhem, Rami
    Hammoud, Mohammad
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 818 - 821
  • [3] PPR-partitioning: a distributed graph partitioning algorithm based on the personalized PageRank vectors in vertex-centric systems
    Nasrin Mazaheri Soudani
    Afsaneh Fatemi
    Mohammadali Nematbakhsh
    Knowledge and Information Systems, 2019, 61 : 847 - 871
  • [4] Vertex-centric Graph Processing on FPGA
    Engelhardt, Nina
    So, Hayden Kwok-Hay
    2016 IEEE 24TH ANNUAL INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES (FCCM), 2016, : 92 - 92
  • [5] PPR-partitioning: a distributed graph partitioning algorithm based on the personalized PageRank vectors in vertex-centric systems
    Soudani, Nasrin Mazaheri
    Fatemi, Afsaneh
    Nematbakhsh, Mohammadali
    KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 61 (02) : 847 - 871
  • [6] SPFC: An Effective Optimization for Vertex-Centric Graph Processing Systems
    Li, Jianxin
    Cao, Yingjie
    Zhang, Yangyang
    Bhuiyan, Zakirul Alam
    Li, Bo
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2019, 4 (01): : 118 - 131
  • [7] Fast Failure Recovery in Vertex-Centric Distributed Graph Processing Systems
    Lu, Wei
    Shen, Yanyan
    Wang, Tongtong
    Zhang, Meihui
    Jagadish, H. V.
    Du, Xiaoyong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (04) : 733 - 746
  • [8] GasCL: A Vertex-Centric Graph Model for GPUs
    Che, Shuai
    2014 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2014,
  • [9] Think Like a Vertex, Behave Like a Function! A Functional DSL for Vertex-Centric Big Graph Processing
    Emoto, Kento
    Matsuzaki, Kiminori
    Hu, Zhenjiang
    Morihata, Akimasa
    Iwasaki, Hideya
    ACM SIGPLAN NOTICES, 2016, 51 (09) : 200 - 213
  • [10] Vertex-Centric Visual Programming for Graph Neural Networks
    Wu, Yidi
    Gui, Yuntao
    Jin, Tatiana
    Cheng, James
    Yan, Xiao
    Yin, Peiqi
    Cai, Yufei
    Tang, Bo
    Yu, Fan
    SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2021, : 2803 - 2807