The Spatiotemporal Data Fusion (STDF) Approach: IoT-Based Data Fusion Using Big Data Analytics

被引:8
|
作者
Fawzy, Dina [1 ]
Moussa, Sherin [1 ]
Badr, Nagwa [1 ]
机构
[1] Ain Shams Univ, Fac Comp & Informat Sci, Informat Syst Dept, Cairo 11566, Egypt
关键词
Internet of Things; big data analytics; data fusion; real-time processing; data reduction; data aggregation; cluster sampling;
D O I
10.3390/s21217035
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Enormous heterogeneous sensory data are generated in the Internet of Things (IoT) for various applications. These big data are characterized by additional features related to IoT, including trustworthiness, timing and spatial features. This reveals more perspectives to consider while processing, posing vast challenges to traditional data fusion methods at different fusion levels for collection and analysis. In this paper, an IoT-based spatiotemporal data fusion (STDF) approach for low-level data in-data out fusion is proposed for real-time spatial IoT source aggregation. It grants optimum performance through leveraging traditional data fusion methods based on big data analytics while exclusively maintaining the data expiry, trustworthiness and spatial and temporal IoT data perspectives, in addition to the volume and velocity. It applies cluster sampling for data reduction upon data acquisition from all IoT sources. For each source, it utilizes a combination of k-means clustering for spatial analysis and Tiny AGgregation (TAG) for temporal aggregation to maintain spatiotemporal data fusion at the processing server. STDF is validated via a public IoT data stream simulator. The experiments examine diverse IoT processing challenges in different datasets, reducing the data size by 95% and decreasing the processing time by 80%, with an accuracy level up to 90% for the largest used dataset.
引用
收藏
页数:30
相关论文
共 50 条
  • [41] An Approach in Big Data Analytics to Improve the Velocity of Unstructured Data Using MapReduce
    Sundarakumar, M. R.
    Mahadevan, G.
    Somula, Ramasubbareddy
    Sennan, Sankar
    Rawal, Bharat S.
    [J]. INTERNATIONAL JOURNAL OF SYSTEM DYNAMICS APPLICATIONS, 2021, 10 (04)
  • [42] Cricket Match Analytics Using the Big Data Approach
    Awan, Mazhar Javed
    Gilani, Syed Arbaz Haider
    Ramzan, Hamza
    Nobanee, Haitham
    Yasin, Awais
    Zain, Azlan Mohd
    Javed, Rabia
    [J]. ELECTRONICS, 2021, 10 (19)
  • [43] A Data Fusion and Data Cleaning System for Smart Grids Big Data
    Lv, Zhining
    Deng, Wei
    Zhang, Zhihan
    Guo, Ningxuan
    Yan, Gangfeng
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 802 - 807
  • [44] Business Process Analytics Using a Big Data Approach
    Vera-Baquero, Alejandro
    Colomo-Palacios, Ricardo
    Molloy, Owen
    [J]. IT PROFESSIONAL, 2013, 15 (06) : 29 - 35
  • [45] An Efficient ACO-based Routing and Data Fusion Approach for IoT Networks
    Ishita Chakraborty
    Prodipto Das
    [J]. SN Computer Science, 4 (6)
  • [46] Distributed Service-Based Approach for Sensor Data Fusion in IoT Environments
    Rodriguez-Valenzuela, Sandra
    Holgado-Terriza, Juan A.
    Gutierrez-Guerrero, Jose M.
    Muros-Cobos, Jesus L.
    [J]. SENSORS, 2014, 14 (10) : 19200 - 19228
  • [47] A big data analytics based machining optimisation approach
    Ji, Wei
    Yin, Shubin
    Wang, Lihui
    [J]. JOURNAL OF INTELLIGENT MANUFACTURING, 2019, 30 (03) : 1483 - 1495
  • [48] A Big Data Analytics Based Approach to Anomaly Detection
    Razaq, Abdul
    Tianfield, Huaglory
    Barrie, Peter
    [J]. 2016 3RD IEEE/ACM INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES (BDCAT), 2016, : 187 - 193
  • [49] Generating Full Spatiotemporal Vehicular Paths: A Data Fusion Approach
    Xiao, Nan
    Hu, Nan
    Yu, Liang
    Long, Cheng
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 2837 - 2844
  • [50] Searchable Encryption Scheme for Personalized Privacy in IoT-Based Big Data
    Li, Shuai
    Li, Miao
    Xu, Haitao
    Zhou, Xianwei
    [J]. SENSORS, 2019, 19 (05)