A Comprehensive Review on Deep Learning-Based Data Fusion

被引:0
|
作者
Hussain, Mazhar [1 ]
O'Nils, Mattias [1 ]
Lundgren, Jan [1 ]
Mousavirad, Seyed Jalaleddin [1 ]
机构
[1] Mid Sweden Univ, STC Res Ctr, S-85170 Sundsvall, Sweden
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Data integration; Reviews; Portfolios; Databases; Remote sensing; Market research; Laser radar; Deep learning; Systematics; Support vector machines; Data fusion; deep learning; early-level fusion; intermediate-level feature fusion; late level decision fusion; hybrid fusion; review; HUMAN ACTIVITY RECOGNITION; FAULT-DIAGNOSIS; NEURAL-NETWORK; ARTIFICIAL-INTELLIGENCE; SEMANTIC SEGMENTATION; SYSTEM; ROAD; ARCHITECTURES; INTEGRATION; PREDICTION;
D O I
10.1109/ACCESS.2024.3508271
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid progress in sensor technology and computational capabilities has significantly improved real-time data collection, enabling precise monitoring of various phenomena and industrial processes. However, the volume and complexity of heterogeneous data present substantial processing challenges. Traditional data-processing techniques, such as data aggregation, filtering, and statistical analysis, are increasingly supplemented by data fusion methods. These methods can be broadly categorised into traditional analytics-based approaches, like the Kalman Filter and Particle Filter, and learning-based approaches, utilising machine learning and deep learning techniques such as Artificial Neural Networks (ANN) and Convolutional Neural Networks (CNN). These techniques combine data from multiple sources to provide a comprehensive and accurate representation of information, which is critical in number of fields. Despite this, a comprehensive review of learning-based, particularly deep learning-based, data fusion strategies is lacking. This paper presents a thorough review of deep learning-based data fusion methodologies across various fields, examining their evolution over the past five years. It highlights applications in remote sensing, healthcare, industrial fault diagnosis, intelligent transportation, and other domains. The paper categories fusion strategies into early-level, intermediate-level, late-level, and hybrid fusion, emphasising their synergies, challenges, and suitability. It outlines significant advancements, the comparative advantages of deep learning-based methods over traditional approaches, and emerging trends and future directions. To ensure a comprehensive analysis, the review is structured using the ProKnow-C methodology, a rigorous selection process that focuses on relevant literature from recent years.
引用
收藏
页码:180093 / 180124
页数:32
相关论文
共 50 条
  • [31] A Comprehensive Review and Analysis of Deep Learning-Based Medical Image Adversarial Attack and Defense
    Muoka, Gladys W.
    Yi, Ding
    Ukwuoma, Chiagoziem C.
    Mutale, Albert
    Ejiyi, Chukwuebuka J.
    Mzee, Asha Khamis
    Gyarteng, Emmanuel S. A.
    Alqahtani, Ali
    Al-antari, Mugahed A.
    MATHEMATICS, 2023, 11 (20)
  • [32] Deep Learning-Based Building Extraction from Remote Sensing Images: A Comprehensive Review
    Luo, Lin
    Li, Pengpeng
    Yan, Xuesong
    ENERGIES, 2021, 14 (23)
  • [33] Deep Learning-Based Single-Image Super-Resolution: A Comprehensive Review
    Chauhan, Karansingh
    Patel, Shail Nimish
    Kumhar, Malaram
    Bhatia, Jitendra
    Tanwar, Sudeep
    Davidson, Innocent Ewean
    Mazibuko, Thokozile F. F.
    Sharma, Ravi
    IEEE ACCESS, 2023, 11 : 21811 - 21830
  • [34] A Comprehensive Review on the Diagnosis of Knee Injury by Deep Learning-Based Magnetic Resonance Imaging
    Shetty, Neha D.
    Dhande, Rajasbala
    Unadkat, Bhavik S.
    Parihar, Pratapsingh
    CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (09)
  • [35] A comprehensive review of deep learning-based approaches for drug-drug interaction prediction
    Xia, Yan
    Xiong, An
    Zhang, Zilong
    Zou, Quan
    Cui, Feifei
    BRIEFINGS IN FUNCTIONAL GENOMICS, 2025, 24
  • [36] Deep Learning-Based Fault Diagnosis of Photovoltaic Systems: A Comprehensive Review and Enhancement Prospects
    Mansouri, Majdi
    Trabelsi, Mohamed
    Nounou, Hazem
    Nounou, Mohamed
    IEEE ACCESS, 2021, 9 : 126286 - 126306
  • [37] Deep Learning-based Environmental Sound Classification Using Feature Fusion and Data Enhancement
    Jahangir, Rashid
    Nauman, Muhammad Asif
    Alroobaea, Roobaea
    Almotiri, Jasem
    Malik, Muhammad Mohsin
    Alzahrani, Sabah M.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (01): : 1069 - 1091
  • [38] Deep Learning-based Anomaly Detection in Radar Data with Radar-Camera Fusion
    Ning, Dian
    Han, Dong Seog
    2023 28TH ASIA PACIFIC CONFERENCE ON COMMUNICATIONS, APCC 2023, 2023, : 107 - 112
  • [39] Data Augmentation in Deep Learning-Based Fusion of Depth and Inertial Sensing for Action Recognition
    Dawar, Neha
    Ostadabbas, Sarah
    Kehtarnavaz, Nasser
    IEEE SENSORS LETTERS, 2019, 3 (01)
  • [40] An Integrated Deep Learning-Based Data Fusion and Degradation Modeling Method for Improving Prognostics
    Wang, Di
    Liu, Kaibo
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (02) : 1713 - 1726