BRGP: a balanced RDF graph partitioning algorithm for cloud storage

被引:11
|
作者
Leng, Yonglin [1 ]
Chen Zhikui [1 ]
Zhong, Fangming [1 ]
Li, Xiongjiu [1 ]
Hu, Yueming [2 ]
Yang, Chao [3 ]
机构
[1] Dalian Univ Technol, Sch Software Technol, Dalian 116620, Peoples R China
[2] South China Agr Univ, Coll Nat Resources & Environm, Guangzhou 510642, Guangdong, Peoples R China
[3] Huabei Oilfield Co, Petr Prod Engn Res Inst, Renqiu 062550, Peoples R China
来源
关键词
cloud storage; RDF; balanced clustering partition; multi-level label propagation; SPARQL;
D O I
10.1002/cpe.3896
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The continuous growth of resource description framework (RDF) data poses an important challenge on RDF data partitioning that is a vital technique for effective cloud storage. Recently, many partitioning algorithms for large RDF data have been developed, and most of them are based on graph partitioning. However, existing graph partitioning methods could not partition asymmetric RDF data effectively, resulting in a lower performance for cloud storage. This paper proposes a balanced RDF graph partitioning algorithm for storing massive RDF data on cloud. We first devise a modularity-based multi-level label propagation algorithm (MMLP) to partition RDF graph roughly and then use a balanced K-mediods clustering algorithm for final k-way partitioning. Balanced RDF graph partitioning algorithm designs an effective label update rule and a balanced modification strategy to achieve a high quality coarsening result and make the partition as equilibrium as possible. Experiments are carried on two representative RDF benchmarks and one real RDF dataset by comparison with two representative graph partitioning methods, that is, METIS and MLP+METIS. Results demonstrate that our proposed scheme can produce a high-quality partition for massive RDF data storage on cloud. Copyright (C) 2016 John Wiley & Sons, Ltd.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Research on partitioning algorithm based on RDF graph
    Zheng, Zhi-yun
    Wang, Chen-yu
    Ding, Yang
    Li, Lun
    Li, Dun
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (08):
  • [2] A polynomial algorithm for balanced clustering via graph partitioning
    Evaristo Caraballo, Luis
    Diaz-Banez, Jose-Miguel
    Kroher, Nadine
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 289 (02) : 456 - 469
  • [3] An Effective Multilevel Memetic Algorithm for Balanced Graph Partitioning
    Benlic, Una
    Hao, Jin-Kao
    22ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2010), PROCEEDINGS, VOL 1, 2010,
  • [4] Balanced Graph Partitioning
    Konstantin Andreev
    Harald Racke
    Theory of Computing Systems, 2006, 39 : 929 - 939
  • [5] Balanced graph partitioning
    Andreev, Konstantin
    Raecke, Harald
    THEORY OF COMPUTING SYSTEMS, 2006, 39 (06) : 929 - 939
  • [6] A Parallel TSP-Based Algorithm for Balanced Graph Partitioning
    Das, Harshvardhan
    Kumar, Subodh
    2017 46TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP), 2017, : 563 - 570
  • [7] JA-BE-JA: A Distributed Algorithm for Balanced Graph Partitioning
    Rahimian, Fatemeh
    Payberah, Amir H.
    Girdzijauskas, Sarunas
    Jelasity, Mark
    Haridi, Seif
    2013 IEEE 7TH INTERNATIONAL CONFERENCE ON SELF-ADAPTIVE AND SELF-ORGANIZING SYSTEMS (SASO), 2013, : 51 - 60
  • [8] JA-BE-JA: A distributed algorithm for balanced graph Partitioning
    Rahimian, Fatemeh
    Payberah, Amir H.
    Girdzijauskas, Sarunas
    Jelasity, Mark
    Haridi, Seif
    International Conference on Self-Adaptive and Self-Organizing Systems, SASO, 2013, : 51 - 60
  • [9] A Partitioning and Index Algorithm for RDF Data of Cloud-Based Robotic Systems
    Leng, Yonglin
    Chen, Zhikui
    Wang, Hongmin
    Zhong, Fangming
    IEEE ACCESS, 2018, 6 : 29836 - 29845
  • [10] DYNAMIC BALANCED GRAPH PARTITIONING
    Avin, Chen
    Bienkowski, Marcin
    Loukas, Andreas
    Pacut, Maciej
    Schmid, Stefan
    SIAM JOURNAL ON DISCRETE MATHEMATICS, 2020, 34 (03) : 1791 - 1812