Exploring the Terrain: An Investigation into Deep Learning-Based Fusion Strategies for Integrating Infrared and Visible Imagery

被引:0
|
作者
Bhatambarekar, Priyanka [1 ]
Phade, Gayatri [2 ]
机构
[1] Sandip Inst Technol & Res Ctr Nashik, Elect & Telecommun Engn, Nasik, Maharashtra, India
[2] Sandip Inst Technol & Res Ctr Nashik, Elect & Telecommun Engn, Nasik, Maharashtra, India
关键词
Image Fusion; Deep Learning (DL); Convolutional Neural Networks (CNN); Generative Adversarial Networks (GAN);
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Infrared and visible image fusion technologies influence distinct image features acquired from distinct sensors, preserving complementary information from input images throughout the process of fusion, and utilizing redundant data to enhance the quality of the resulting fused image. Recently, deep learning methods (DL) have been employed by numerous researchers to investigate image fusion, revealing that the application of DL significantly enhances the efficiency of the model and the quality of fusion outcomes. Nevertheless, it is very important to note that DL can be implemented in various branches, and currently, a comprehensive investigation of deep learningbased methods in image fusion is in process.The paper aims to provide an exhaustive review of the evolution of image fusion algorithms grounded in deep learning over the years. Precisely, this paper undertakes a particular exploration of the fusion techniques applied to infrared and visible images through deep learning methodologies. The investigation includes a qualitative and quantitative comparison of extant fusion algorithms using established quality indicators, along with a thorough discussion of diverse fusion approaches. The current research status concerning infrared and visible image fusion is presented, with a forward-looking perspective on potential future directions. This research makes an effort to contribute valuable insights into various image fusion methods developed in recent years, thereby laying a solid foundation for subsequent research goings-on in this domain.
引用
收藏
页码:2316 / 2327
页数:12
相关论文
共 50 条
  • [1] FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery
    J. F. Ciprián-Sánchez
    G. Ochoa-Ruiz
    M. Gonzalez-Mendoza
    L. Rossi
    Neural Computing and Applications, 2023, 35 : 18201 - 18213
  • [2] FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery
    Ciprian-Sanchez, J. F.
    Ochoa-Ruiz, G.
    Gonzalez-Mendoza, M.
    Rossi, L.
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (25): : 18201 - 18213
  • [3] Infrared and Visible Image Fusion Based on NSCT and Deep Learning
    Feng, Xin
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2018, 14 (06): : 1405 - 1419
  • [4] TU-Net and TDeepLab: Deep Learning-based Terrain Classification Robust to Illumination Changes, Combining Visible and Thermal Imagery
    Iwashita, Yumi
    Nakashima, Kazuto
    Stoica, Adrian
    Kurazume, Ryo
    2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 280 - 285
  • [5] Deep Learning-Based Fusion of Visible Light Positioning and IMU Sensors
    Hua, Luchi
    Zhuang, Yuan
    Yang, Jun
    20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 565 - 571
  • [6] Vision based nighttime pavement cracks pixel level detection by integrating infrared visible fusion and deep learning
    Shi, Mengnan
    Li, Hongtao
    Yao, Qiang
    Zeng, Jun
    Wang, Junmu
    CONSTRUCTION AND BUILDING MATERIALS, 2024, 442
  • [7] Infrared and Visible Image Fusion Techniques Based on Deep Learning: A Review
    Sun, Changqi
    Zhang, Cong
    Xiong, Naixue
    ELECTRONICS, 2020, 9 (12) : 1 - 24
  • [8] Deep Learning-based Drone Detection in Infrared Imagery with Limited Training Data
    Sommer, Lars
    Schumann, Arne
    COUNTERTERRORISM, CRIME FIGHTING, FORENSICS, AND SURVEILLANCE TECHNOLOGIES IV, 2020, 11542
  • [9] Visible and Infrared Image Fusion Using Deep Learning
    Zhang, Xingchen
    Demiris, Yiannis
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 10535 - 10554
  • [10] Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion
    Li, Huafeng
    Cen, Yueliang
    Liu, Yu
    Chen, Xun
    Yu, Zhengtao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4070 - 4083