FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

被引:22
|
作者
Ciprian-Sanchez, J. F. [1 ]
Ochoa-Ruiz, G. [2 ]
Gonzalez-Mendoza, M. [2 ]
Rossi, L. [3 ]
机构
[1] Tecnol Monterrey, Sch Engn & Sci, Av Lago Guadalupe KM 3-5, Margarita Maza De Juarez 52926, Cd Lopez Mateos, Mexico
[2] Tecnol Monterrey, Sch Engn & Sci, Av Eugenio Garza Sada 2501, Monterrey 64849, NL, Mexico
[3] Univ Corsica, Lab Sci Environm, Campus Grimaldi BP 52, F-20250 Corte, France
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 25期
关键词
Image fusion; Fire; Wildfires; Deep learning; Visible; Infrared; COMPUTER VISION; NETWORK;
D O I
10.1007/s00521-021-06691-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. In this regard, the fusion of thermal and visible information into a single image can potentially increase the robustness and accuracy of wildfire detection models. In the field of visible-infrared image fusion, there is a growing interest in Deep Learning (DL)-based image fusion techniques due to their reduced complexity; however, the most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. In the present work, we select three state-of-the-art (SOTA) DL-based image fusion techniques and evaluate them for the specific task of fire image fusion, and compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared and fused images.
引用
收藏
页码:18201 / 18213
页数:13
相关论文
共 50 条
  • [21] Explainable analysis of infrared and visible light image fusion based on deep learning
    Yuan, Bo
    Sun, Hongyu
    Guo, Yinjing
    Liu, Qiang
    Zhan, Xinghao
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [22] Unsupervised Infrared Image and Visible Image Fusion Algorithm Based on Deep Learning
    Chen Guoyang
    Wu Xiaojun
    Xu Tianyang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [23] Infrared-visible image fusion method based on sparse and prior joint saliency detection and LatLRR-FPDE
    Li, Yonghua
    Liu, Gang
    Bavirisetti, Durga Prasad
    Gu, Xinjie
    Zhou, Xihong
    DIGITAL SIGNAL PROCESSING, 2023, 134
  • [24] Shortwave infrared and visible light image fusion method based on dual discriminator GAN
    Huang, Pengxing
    Liu, Xiaojie
    Zhao, Shiqi
    Ma, Ruyue
    Dong, Hao
    Wang, Chenguang
    Cao, Huiliang
    Shen, Chong
    PHYSICA SCRIPTA, 2024, 99 (03)
  • [25] An infrared and visible image fusion method based on deep convolutional feature extraction
    Pang Z.-X.
    Liu G.-H.
    Chen C.-M.
    Liu H.-T.
    Kongzhi yu Juece/Control and Decision, 2024, 39 (03): : 910 - 918
  • [26] Deep Learning-Based Pine Nematode Trees' Identification Using Multispectral and Visible UAV Imagery
    Qin, Bingxi
    Sun, Fenggang
    Shen, Weixing
    Dong, Bin
    Ma, Shencheng
    Huo, Xinyu
    Lan, Peng
    DRONES, 2023, 7 (03)
  • [27] An Enhanced Deep Learning-Based Fusion Prognostic Method for RUL Prediction
    Huang, Cheng-Geng
    Yin, Xianhui
    Huang, Hong-Zhong
    Li, Yan-Feng
    IEEE TRANSACTIONS ON RELIABILITY, 2020, 69 (03) : 1097 - 1109
  • [28] A Novel Bearing Fault Classification Method Based on XGBoost: The Fusion of Deep Learning-Based Features and Empirical Features
    Xie, Jingsong
    Li, Zhaoyang
    Zhou, Zitong
    Liu, Scarlett
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [29] Effective Deep Learning-Based Infrared Spectral Gas Identification Method
    Wang, Zhikang
    Zhao, Guodong
    ADVANCED THEORY AND SIMULATIONS, 2024, 7 (03)
  • [30] A novel deep learning-based method for detection of weeds in vegetables
    Jin, Xiaojun
    Sun, Yanxia
    Che, Jun
    Bagavathiannan, Muthukumar
    Yu, Jialin
    Chen, Yong
    PEST MANAGEMENT SCIENCE, 2022, 78 (05) : 1861 - 1869