MusQ: A Multi-Store Query System for IoT Data Using a Datalog-Like Language

被引:8
|
作者
Ramadhan, Hani [1 ]
Indikawati, Fitri Indra [2 ]
Kwon, Joonho [3 ]
Koo, Bonyong [4 ]
机构
[1] Pusan Natl Univ, Dept Big Data, Busan 46241, South Korea
[2] Ahmad Dahlan Univ, Dept Informat Engn, Yogyakarta 55166, Indonesia
[3] Pusan Natl Univ, Sch Comp Sci & Engn, Busan 46241, South Korea
[4] Kunsan Natl Univ, Sch Mech Syst Engn, Gunsan 54150, South Korea
基金
新加坡国家研究基金会;
关键词
Data management and analytics; Internet of Things; multi-store system; query processing; schema integration; INTERNET; THINGS; INTEGRATION; MANAGEMENT;
D O I
10.1109/ACCESS.2020.2982472
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The growing number of connected Internet of Things (IoT) devices has increased the necessity for processing IoT data from multiple heterogeneous data stores. IoT data integration is a challenging problem owing to the heterogeneity of data stores in terms of their query language, data models, and schemas. In this paper, we propose a multi-store query system for IoT data called MusQ, where users can formulate join operation queries for heterogeneous data sources. To reconcile the heterogeneity between source schemas of IoT data stores, we extract a global schema from local source schemas semi-automatically by applying schema-matching and schema-mapping steps. In order to minimize the burden on the user to understand the finer details of various query languages, we define a unified query language called the multi-store query language (MQL), which follows a subset of the Datalog grammar. Thus, users can easily retrieve IoT data from multiple heterogeneous sources with MQL queries. As the three MQL query-processing join algorithms are based on a mediator & x2013;wrapper approach, MusQ performs efficient data integration over significant volumes of IoT data from multiple stores. We conduct extensive experiments to evaluate the performance of the MusQ system using a synthetic and large real IoT data set for three different types of data stores (RDBMS, NoSQL, and HDFS). The experimental results demonstrate that MusQ is suitable, scalable, and efficient query processing for multiple heterogeneous IoT data stores. Those advantages of MusQ are important in several areas that involve complex IoT systems, such as smart city, healthcare, and energy management.
引用
收藏
页码:58032 / 58056
页数:25
相关论文
共 5 条
  • [1] Rhyme: A Data-Centric Multi-paradigm Query Language Based on Functional Logic Metaprogramming System Description
    Abeysinghe, Supun
    Rompf, Tiark
    [J]. FUNCTIONAL AND LOGIC PROGRAMMING, FLOPS 2024, 2024, 14659 : 273 - 288
  • [2] Cloud Based Data Analysis and Monitoring of Smart Multi-level Irrigation System Using IoT
    Salvi, Sanket
    Jain, Pramod S. A.
    Sanjay, H. A.
    Harshita, T. K.
    Farhana, M.
    Jain, Naveen
    Suhas, M., V
    [J]. 2017 INTERNATIONAL CONFERENCE ON I-SMAC (IOT IN SOCIAL, MOBILE, ANALYTICS AND CLOUD) (I-SMAC), 2017, : 752 - 757
  • [3] An IoT System for Social Distancing and Emergency Management in Smart Cities Using Multi-Sensor Data
    Fedele, Rosario
    Merenda, Massimo
    [J]. ALGORITHMS, 2020, 13 (10) : 1 - 24
  • [4] Multi-speaker TTS system for low-resource language using cross-lingual transfer learning and data augmentation
    Byambadorj, Zolzaya
    Nishimura, Ryota
    Ayush, Altangerel
    Ohta, Kengo
    Kitaoka, Norihide
    [J]. 2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 849 - 853
  • [5] An Improved Coupled Data Assimilation System with a CGCM Using Multi-Time-Scale High-Efficiency EnOI-Like Filtering
    Lu, Lv
    Zhang, Shaoqing
    Jiang, Yingjing
    Yu, Xiaolin
    Li, Mingkui
    Chen, Yuhu
    Chang, Ping
    Danabasoglu, Gokhan
    Liu, Zhengyu
    Zhu, Chenyu
    Lin, Xiaopei
    Wu, Lixin
    [J]. JOURNAL OF CLIMATE, 2023, 36 (17) : 6045 - 6067