FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

被引:22
|
作者
Ciprian-Sanchez, J. F. [1 ]
Ochoa-Ruiz, G. [2 ]
Gonzalez-Mendoza, M. [2 ]
Rossi, L. [3 ]
机构
[1] Tecnol Monterrey, Sch Engn & Sci, Av Lago Guadalupe KM 3-5, Margarita Maza De Juarez 52926, Cd Lopez Mateos, Mexico
[2] Tecnol Monterrey, Sch Engn & Sci, Av Eugenio Garza Sada 2501, Monterrey 64849, NL, Mexico
[3] Univ Corsica, Lab Sci Environm, Campus Grimaldi BP 52, F-20250 Corte, France
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 25期
关键词
Image fusion; Fire; Wildfires; Deep learning; Visible; Infrared; COMPUTER VISION; NETWORK;
D O I
10.1007/s00521-021-06691-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. In this regard, the fusion of thermal and visible information into a single image can potentially increase the robustness and accuracy of wildfire detection models. In the field of visible-infrared image fusion, there is a growing interest in Deep Learning (DL)-based image fusion techniques due to their reduced complexity; however, the most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. In the present work, we select three state-of-the-art (SOTA) DL-based image fusion techniques and evaluate them for the specific task of fire image fusion, and compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared and fused images.
引用
收藏
页码:18201 / 18213
页数:13
相关论文
共 50 条
  • [1] FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery
    J. F. Ciprián-Sánchez
    G. Ochoa-Ruiz
    M. Gonzalez-Mendoza
    L. Rossi
    Neural Computing and Applications, 2023, 35 : 18201 - 18213
  • [2] Exploring the Terrain: An Investigation into Deep Learning-Based Fusion Strategies for Integrating Infrared and Visible Imagery
    Bhatambarekar, Priyanka
    Phade, Gayatri
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (02) : 2316 - 2327
  • [3] Strawberry Defect Identification Using Deep Learning Infrared-Visible Image Fusion
    Lu, Yuze
    Gong, Mali
    Li, Jing
    Ma, Jianshe
    AGRONOMY-BASEL, 2023, 13 (09):
  • [4] Saliency Detection and Deep Learning-Based Wildfire Identification in UAV Imagery
    Zhao, Yi
    Ma, Jiale
    Li, Xiaohui
    Zhang, Jie
    SENSORS, 2018, 18 (03)
  • [5] Early Forest Fire Detection With UAV Image Fusion: A Novel Deep Learning Method Using Visible and Infrared Sensors
    Niu, Kunlong
    Wang, Chongyang
    Xu, Jianhui
    Liang, Jianrong
    Zhou, Xia
    Wen, Kaixiang
    Lu, Minjian
    Yang, Chuanxun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 6617 - 6629
  • [6] Fusion of Infrared-Visible Images in UE-IoT for Fault Point Detection Based on GAN
    Liao, Bin
    Du, You
    Yin, Xiangyun
    IEEE ACCESS, 2020, 8 : 79754 - 79763
  • [7] Infrared and Visible Image Fusion: A Region-Based Deep Learning Method
    Xie, Chunyu
    Li, Xinde
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT V, 2019, 11744 : 604 - 615
  • [8] A DT-CWT-based infrared-visible image fusion method for smart city
    Qi G.
    Zheng M.
    Zhu Z.
    Yuan R.
    International Journal of Simulation and Process Modelling, 2019, 14 (06) : 559 - 570
  • [9] A deep learning based relative clarity classification method for infrared and visible image fusion
    Abera, Deboch Eyob
    Qi, Jin
    Cheng, Jian
    INFRARED PHYSICS & TECHNOLOGY, 2024, 140
  • [10] Infrared and Visible Image Fusion Based on NSCT and Deep Learning
    Feng, Xin
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2018, 14 (06): : 1405 - 1419