An investigation of big graph partitioning methods for distribution of graphs in vertex-centric systems

被引:0
|
作者
Nasrin Mazaheri Soudani
Afsaneh Fatemi
Mohammadali Nematbakhsh
机构
[1] University of Isfahan,Department of Computer Engineering
来源
关键词
Graph partitioning; Vertex-centric systems; Big graphs; Distributed computing;
D O I
暂无
中图分类号
学科分类号
摘要
Relations among data entities in most big data sets can be modeled by a big graph. Implementation and execution of algorithms related to the structure of big graphs is very important in different fields. Because of the inherently high volume of big graphs, their calculations should be performed in a distributed manner. Some distributed systems based on vertex-centric model have been introduced for big graph calculations in recent years. The performance of these systems in terms of run time depends on the partitioning and distribution of the graph. Therefore, the graph partitioning is a major concern in this field. This paper concentrates on big graph partitioning approaches for distribution of graphs in vertex-centric systems. This briefly discusses vertex-centric systems and formulates different models of graph partitioning problem. Then, a review of recent methods of big graph partitioning for these systems is shown. Most recent methods of big graph partitioning for vertex centric systems can be categorized into three classes: (i) stream-based methods that see vertices or edges of the graph in a stream and partition them, (ii) distributed methods that partition vertices or edges in a distributed manner, and (iii) dynamic methods that change partitions during the execution of algorithms to obtain better performance. This study compares the properties of different approaches in each class and briefly reviews methods that are not in these categories. This comparison indicates that The streaming methods are good choices for initial load of the graph in Vertex-centric systems. The distributed and dynamic methods are appropriate for long-running applications.
引用
收藏
页码:1 / 29
页数:28
相关论文
共 50 条
  • [31] ScaleG: A Distributed Disk-Based System for Vertex-Centric Graph Processing
    Wang, Xubo
    Wen, Dong
    Qin, Lu
    Chang, Lijun
    Zhang, Ying
    Zhang, Wenjie
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 2019 - 2033
  • [32] Composing Optimization Techniques for Vertex-Centric Graph Processing via Communication Channels
    Zhang, Yongzhe
    Hu, Zhenjiang
    2019 IEEE 33RD INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2019), 2019, : 428 - 438
  • [33] Performance Modeling of Computation and Communication Tradeoffs in Vertex-Centric Graph Processing Clusters
    Abdolrashidi, Amirreza
    Ramaswamy, Lakshmish
    Narron, David Seamus
    2014 INTERNATIONAL CONFERENCE ON COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING (COLLABORATECOM), 2014, : 55 - 63
  • [34] VCSR: Mutable CSR Graph Format Using Vertex-Centric Packed Memory Array
    Islam, Abdullah Al Ragibul
    Dai, Dong
    Cheng, Dazhao
    2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 71 - 80
  • [35] Vertex-centric Parallel Algorithms for Identifying Key Vertices in Large-scale Graphs
    Li, Bo
    Gao, Zhuangliang
    Niu, Jianwei
    Lv, YanFei
    Zhang, Hong
    2015 IEEE 17TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2015 IEEE 7TH INTERNATIONAL SYMPOSIUM ON CYBERSPACE SAFETY AND SECURITY, AND 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS), 2015, : 225 - 231
  • [36] Enabling Work-Efficiency for High Performance Vertex-Centric Graph Analytics on GPUs
    Khorasani, Farzad
    Vora, Keval
    Gupta, Rajiv
    Bhuyan, Laxmi N.
    PROCEEDINGS OF IA3 2017: SEVENTH WORKSHOP ON IRREGULAR APPLICATIONS: ARCHITECTURES AND ALGORITHMS, 2017,
  • [37] Performance-driven System Generation for Distributed Vertex-Centric Graph Processing on Multi-FPGA Systems
    Engelhardt, Nina
    Hung, C. -H. Dominic
    So, Hayden K. -H.
    2018 28TH INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS (FPL), 2018, : 215 - 218
  • [38] s6raph: Vertex-Centric Graph Processing Framework with Functional Interface
    Ruiz, Onofre Coll
    Matsuzaki, Kiminori
    Sato, Shigeyuki
    FHPC'16: PROCEEDINGS OF THE 5TH INTERNATIONAL WORKSHOP ON FUNCTIONAL HIGH-PERFORMANCE COMPUTING, 2016, : 58 - 64
  • [39] DFA-G: A Unified Programming Model for Vertex-centric Parallel Graph Processing
    Suo, Bo
    Su, Jing
    Chen, Qun
    Li, Zhanhuai
    Pan, Wei
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2016, : 1328 - 1331
  • [40] Palgol: A High-Level DSL for Vertex-Centric Graph Processing with Remote Data Access
    Zhang, Yongzhe
    Ko, Hsiang-Shang
    Hu, Zhenjiang
    PROGRAMMING LANGUAGES AND SYSTEMS (APLAS 2017), 2017, 10695 : 301 - 320