An investigation of big graph partitioning methods for distribution of graphs in vertex-centric systems

被引:0
|
作者
Nasrin Mazaheri Soudani
Afsaneh Fatemi
Mohammadali Nematbakhsh
机构
[1] University of Isfahan,Department of Computer Engineering
来源
关键词
Graph partitioning; Vertex-centric systems; Big graphs; Distributed computing;
D O I
暂无
中图分类号
学科分类号
摘要
Relations among data entities in most big data sets can be modeled by a big graph. Implementation and execution of algorithms related to the structure of big graphs is very important in different fields. Because of the inherently high volume of big graphs, their calculations should be performed in a distributed manner. Some distributed systems based on vertex-centric model have been introduced for big graph calculations in recent years. The performance of these systems in terms of run time depends on the partitioning and distribution of the graph. Therefore, the graph partitioning is a major concern in this field. This paper concentrates on big graph partitioning approaches for distribution of graphs in vertex-centric systems. This briefly discusses vertex-centric systems and formulates different models of graph partitioning problem. Then, a review of recent methods of big graph partitioning for these systems is shown. Most recent methods of big graph partitioning for vertex centric systems can be categorized into three classes: (i) stream-based methods that see vertices or edges of the graph in a stream and partition them, (ii) distributed methods that partition vertices or edges in a distributed manner, and (iii) dynamic methods that change partitions during the execution of algorithms to obtain better performance. This study compares the properties of different approaches in each class and briefly reviews methods that are not in these categories. This comparison indicates that The streaming methods are good choices for initial load of the graph in Vertex-centric systems. The distributed and dynamic methods are appropriate for long-running applications.
引用
收藏
页码:1 / 29
页数:28
相关论文
共 50 条
  • [41] Combining Vertex-Centric Graph Processing with SPARQL for Large-Scale RDF Data Analytics
    Abdelaziz, Ibrahim
    Harbi, Razen
    Salihoglu, Semih
    Kalnis, Panos
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (12) : 3374 - 3388
  • [42] ScaleG: A Distributed Disk-based System for Vertex-centric Graph Processing (Extended Abstract)
    Wang, Xubo
    Wen, Dong
    Qin, Lu
    Chang, Lijun
    Zhang, Wenjie
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 1511 - 1512
  • [43] Fregel: a functional domain-specific language for vertex-centric large-scale graph processing
    Iwasaki, Hideya
    Emoto, Kento
    Morihata, Akimasa
    Matsuzaki, Kiminori
    Hu, Zhenjiang
    JOURNAL OF FUNCTIONAL PROGRAMMING, 2022, 32 (02)
  • [44] VMap: An Interactive Rectangular Space-filling Visualization for Map-like Vertex-centric Graph Exploration
    Xu, Jiayi
    Shen, Han-Wei
    arXiv, 2023,
  • [45] Continual and Cost-Effective Partitioning of Dynamic Graphs for Optimizing Big Graph Processing Systems
    Abdolrashidi, Amirreza
    Ramaswamy, Lakshmish
    2016 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2016, 2016, : 18 - 25
  • [46] Optimizing Vertex Pressure Dynamic Graph Partitioning in Many-Core Systems
    McCrabb, Andrew
    Bertacco, Valeria
    IEEE TRANSACTIONS ON COMPUTERS, 2021, 70 (06) : 936 - 949
  • [47] iPartition: a distributed partitioning algorithm for block-centric graph processing systems
    Masoud Sagharichian
    Morteza Alipour Langouri
    The Journal of Supercomputing, 2023, 79 : 21116 - 21143
  • [48] iPartition: a distributed partitioning algorithm for block-centric graph processing systems
    Sagharichian, Masoud
    Langouri, Morteza Alipour
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (18): : 21116 - 21143
  • [49] The Future Is Big Graphs: A Community View on Graph Processing Systems
    Sakr, Sherif
    Bonifati, Angela
    Voigt, Hannes
    Iosup, Alexandru
    COMMUNICATIONS OF THE ACM, 2021, 64 (09) : 62 - 71
  • [50] Graph Partitioning in the Analysis of Pressure Dependent Water Distribution Systems
    Elhay, Sylvan
    Deuerlein, Jochen
    Piller, Olivier
    Simpson, Angus R.
    JOURNAL OF WATER RESOURCES PLANNING AND MANAGEMENT, 2018, 144 (04)