An efficient and scalable SPARQL query processing framework for big data using MapReduce and hybrid optimum load balancing

被引:0
|
作者
Kumar, V. Naveen [1 ]
Kumar, P. S. Ashok [2 ]
机构
[1] Visvesvaraya Technol Univ, Don Bosco Inst Technol, Bengaluru 560074, Karnataka, India
[2] Visvesvaraya Technol Univ, ACS Coll Engn, Dept CSE, Bengaluru 560074, Karnataka, India
关键词
RDF data storage; SPARQL querying; Hadoop; Extended vertical partitioning; Hybrid optimum load balancing; RDF DATA;
D O I
10.1016/j.datak.2023.102239
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increasing RDF (Resource Description Framework) data volume requires a Hadoop platform for processing queries over large datasets. In this work, SPARQL (Simple Protocol and Rdf Query Language) queries are evaluated with Hadoop based on the objective of minimizing the number of joins through data partitioning for performing map/reduce jobs. The query evaluation time and the number of cross node joins are minimized with the proposed partitioning techniques. Extended vertical partitioning is proposed for distributed data stores based on objects' explicit information for splitting predicates. For accessing the RDF data, hybrid monarch butterfly with beetle swarm load balancing optimization with Map-reduce (Hybrid Optimum Load Balancing) is applied. The proposed SPARQL query processing is evaluated over large RDF datasets. The proposed approach's evaluation results are analyzed with the existing approaches, indicating the proposed framework's efficiency. By using the proposed approach, an accuracy of 97 % is obtained.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Efficient indexing and retrieval of patient information from the big data using MapReduce framework and optimisation
    Merlin, N. R. Gladiss
    Prem, M. Vigilson
    [J]. JOURNAL OF INFORMATION SCIENCE, 2023, 49 (02) : 500 - 518
  • [32] ASTOR - a compute framework for Scalable Distributed Big Data Processing
    Prathapan, Smriti
    Golpayegani, Navid
    Wyatt, Bryan
    Halem, Milton
    Dorband, John
    Trantham, Jon D.
    Markey, Chris A.
    [J]. BIG DATA II: LEARNING, ANALYTICS, AND APPLICATIONS, 2020, 11395
  • [33] Efficient, Problem Tailored Big Data Processing Using Framework Delegation
    Davis, Nickolas
    Broomfield, Matthew
    Rezgui, Abdelmounaam
    [J]. 2016 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATION (ISCC), 2016, : 1297 - 1299
  • [34] A FAST BIG DATA COLLECTION SYSTEM USING MAPREDUCE FRAMEWORK
    Bing, Li
    Chan, Keith C. C.
    [J]. 2014 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2014, : 530 - 535
  • [35] StarMR: An Efficient Star-Decomposition Based Query Processor for SPARQL Basic Graph Patterns Using MapReduce
    Xu, Qiang
    Wang, Xin
    Li, Jianxin
    Gan, Ying
    Chai, Lele
    Wang, Junhu
    [J]. WEB AND BIG DATA (APWEB-WAIM 2018), PT I, 2018, 10987 : 415 - 430
  • [36] Feature Selection and Classification of Big Data Using MapReduce Framework
    Devi, D. Renuka
    Sasikala, S.
    [J]. INTELLIGENT COMPUTING, INFORMATION AND CONTROL SYSTEMS, ICICCS 2019, 2020, 1039 : 666 - 673
  • [37] Handling Big Data Using MapReduce Over Hybrid Cloud
    Saxena, Ankur
    Chaurasia, Ankur
    Kaushik, Neeraj
    Kaushik, Nidhi
    [J]. INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING AND COMMUNICATIONS, VOL 2, 2019, 56 : 135 - 144
  • [38] Distributed XPath Query Processing over Large XML Data based on MapReduce framework
    Fan, Hongjie
    Wang, Dongsheng
    Liu, Junfei
    [J]. 2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1447 - 1453
  • [39] A Framework for Fast MapReduce Processing Considering Sensitive Data on Hybrid Clouds
    Kawamoto, Shun
    Kamidoi, Yoko
    Wakabayashi, Shin'ichi
    [J]. 2020 IEEE 44TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2020), 2020, : 1357 - 1362
  • [40] A Study on Load Balancing Techniques for Task Allocation in Big Data Processing
    Jin Xiaohong
    Li Hui
    Liu Yanjun
    Fan Yanfang
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL FORUM ON MECHANICAL, CONTROL AND AUTOMATION (IFMCA 2016), 2017, 113 : 212 - 218