FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

被引:22
|
作者
Ciprian-Sanchez, J. F. [1 ]
Ochoa-Ruiz, G. [2 ]
Gonzalez-Mendoza, M. [2 ]
Rossi, L. [3 ]
机构
[1] Tecnol Monterrey, Sch Engn & Sci, Av Lago Guadalupe KM 3-5, Margarita Maza De Juarez 52926, Cd Lopez Mateos, Mexico
[2] Tecnol Monterrey, Sch Engn & Sci, Av Eugenio Garza Sada 2501, Monterrey 64849, NL, Mexico
[3] Univ Corsica, Lab Sci Environm, Campus Grimaldi BP 52, F-20250 Corte, France
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 25期
关键词
Image fusion; Fire; Wildfires; Deep learning; Visible; Infrared; COMPUTER VISION; NETWORK;
D O I
10.1007/s00521-021-06691-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. In this regard, the fusion of thermal and visible information into a single image can potentially increase the robustness and accuracy of wildfire detection models. In the field of visible-infrared image fusion, there is a growing interest in Deep Learning (DL)-based image fusion techniques due to their reduced complexity; however, the most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. In the present work, we select three state-of-the-art (SOTA) DL-based image fusion techniques and evaluate them for the specific task of fire image fusion, and compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared and fused images.
引用
收藏
页码:18201 / 18213
页数:13
相关论文
共 50 条
  • [11] Deep Learning-based Wildfire Smoke Detection using Uncrewed Aircraft System Imagery
    Mahmud, Khan Raqib
    Wang, Lingxiao
    Liu, Xiyuan
    Li, Jiahao
    Hassan, Sunzid
    2024 21ST INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS, UR 2024, 2024, : 580 - 587
  • [12] An automatic building façade deterioration detection system using infrared-visible image fusion and deep learning
    Wang, Pujin
    Xiao, Jianzhuang
    Qiang, Xingxing
    Xiao, Rongwei
    Liu, Yi
    Sun, Chang
    Hu, Jianhui
    Liu, Shijie
    JOURNAL OF BUILDING ENGINEERING, 2024, 95
  • [13] Deep Learning-Based Fusion of Visible Light Positioning and IMU Sensors
    Hua, Luchi
    Zhuang, Yuan
    Yang, Jun
    20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 565 - 571
  • [14] Infrared-Visible Light Image Fusion Method Based on Weighted Salience Detection and Visual Information Preservation
    Liu, Yibo
    Ke, Ting
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024, 2024, 14867 : 159 - 168
  • [15] Infrared and Visible Image Fusion Techniques Based on Deep Learning: A Review
    Sun, Changqi
    Zhang, Cong
    Xiong, Naixue
    ELECTRONICS, 2020, 9 (12) : 1 - 24
  • [16] An Infrared and Visible Fusion Framework Based on a Novel Decomposition Method
    Xiao, Rui
    Cheng, Feiyan
    Shi, Junsheng
    Wang, Yuanfangzhou
    Li, Chengli
    SYMMETRY-BASEL, 2022, 14 (04):
  • [17] Deep Learning-based Drone Detection in Infrared Imagery with Limited Training Data
    Sommer, Lars
    Schumann, Arne
    COUNTERTERRORISM, CRIME FIGHTING, FORENSICS, AND SURVEILLANCE TECHNOLOGIES IV, 2020, 11542
  • [18] Infrared-visible image fusion method based on multi-scale shearing Co-occurrence filter
    Zhu, Fang
    Liu, Wei
    INFRARED PHYSICS & TECHNOLOGY, 2024, 136
  • [19] Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion
    Li, Huafeng
    Cen, Yueliang
    Liu, Yu
    Chen, Xun
    Yu, Zhengtao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4070 - 4083
  • [20] A deep learning and image enhancement based pipeline for infrared and visible image fusion
    Qi, Jin
    Eyob, Deboch
    Fanose, Mola Natnael
    Wang, Lingfeng
    Cheng, Jian
    NEUROCOMPUTING, 2024, 578