BRGP: a balanced RDF graph partitioning algorithm for cloud storage

被引:11
|
作者
Leng, Yonglin [1 ]
Chen Zhikui [1 ]
Zhong, Fangming [1 ]
Li, Xiongjiu [1 ]
Hu, Yueming [2 ]
Yang, Chao [3 ]
机构
[1] Dalian Univ Technol, Sch Software Technol, Dalian 116620, Peoples R China
[2] South China Agr Univ, Coll Nat Resources & Environm, Guangzhou 510642, Guangdong, Peoples R China
[3] Huabei Oilfield Co, Petr Prod Engn Res Inst, Renqiu 062550, Peoples R China
来源
关键词
cloud storage; RDF; balanced clustering partition; multi-level label propagation; SPARQL;
D O I
10.1002/cpe.3896
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The continuous growth of resource description framework (RDF) data poses an important challenge on RDF data partitioning that is a vital technique for effective cloud storage. Recently, many partitioning algorithms for large RDF data have been developed, and most of them are based on graph partitioning. However, existing graph partitioning methods could not partition asymmetric RDF data effectively, resulting in a lower performance for cloud storage. This paper proposes a balanced RDF graph partitioning algorithm for storing massive RDF data on cloud. We first devise a modularity-based multi-level label propagation algorithm (MMLP) to partition RDF graph roughly and then use a balanced K-mediods clustering algorithm for final k-way partitioning. Balanced RDF graph partitioning algorithm designs an effective label update rule and a balanced modification strategy to achieve a high quality coarsening result and make the partition as equilibrium as possible. Experiments are carried on two representative RDF benchmarks and one real RDF dataset by comparison with two representative graph partitioning methods, that is, METIS and MLP+METIS. Results demonstrate that our proposed scheme can produce a high-quality partition for massive RDF data storage on cloud. Copyright (C) 2016 John Wiley & Sons, Ltd.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Spinner: Scalable Graph Partitioning in the Cloud
    Martella, Claudio
    Logothetis, Dionysios
    Loukas, Andreas
    Siganos, Georgos
    2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2017), 2017, : 1083 - 1094
  • [32] Isoperimetric partitioning: A new algorithm for graph partitioning
    Grady, L
    Schwartz, EL
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2006, 27 (06): : 1844 - 1866
  • [33] A Distributed Algorithm for Balanced Hypergraph Partitioning
    Yang, Wenyin
    Wang, Guojun
    Ma, Li
    Wu, Shiyang
    ADVANCES IN SERVICES COMPUTING, 2016, 10065 : 477 - 490
  • [34] Genetic algorithm and graph partitioning
    Bui, TN
    Moon, BR
    IEEE TRANSACTIONS ON COMPUTERS, 1996, 45 (07) : 841 - 855
  • [35] A genetic algorithm for graph partitioning
    Kureichik, VM
    Kureichik, VV
    JOURNAL OF COMPUTER AND SYSTEMS SCIENCES INTERNATIONAL, 1999, 38 (04) : 580 - 588
  • [36] A multiagent algorithm for graph partitioning
    Comellas, R
    Sapena, E
    APPLICATIONS OF EVOLUTIONARY COMPUTING, PROCEEDINGS, 2006, 3907 : 279 - 285
  • [37] AN ALGORITHM FOR PARTITIONING THE NODES OF A GRAPH
    BARNES, ER
    SIAM JOURNAL ON ALGEBRAIC AND DISCRETE METHODS, 1982, 3 (04): : 541 - 550
  • [38] An exact algorithm for graph partitioning
    Hager, William W.
    Phan, Dzung T.
    Zhang, Hongchao
    MATHEMATICAL PROGRAMMING, 2013, 137 (1-2) : 531 - 556
  • [39] A Fractal algorithm for graph partitioning
    Kureichik, VV
    Kureichik, VM
    JOURNAL OF COMPUTER AND SYSTEMS SCIENCES INTERNATIONAL, 2002, 41 (04) : 568 - 578
  • [40] HEURISTIC ALGORITHM FOR PARTITIONING OF A GRAPH
    MILGRAM, M
    DUBUISSON, B
    RAIRO-RECHERCHE OPERATIONNELLE-OPERATIONS RESEARCH, 1977, 11 (02): : 175 - 199