FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

被引:22
|
作者
Ciprian-Sanchez, J. F. [1 ]
Ochoa-Ruiz, G. [2 ]
Gonzalez-Mendoza, M. [2 ]
Rossi, L. [3 ]
机构
[1] Tecnol Monterrey, Sch Engn & Sci, Av Lago Guadalupe KM 3-5, Margarita Maza De Juarez 52926, Cd Lopez Mateos, Mexico
[2] Tecnol Monterrey, Sch Engn & Sci, Av Eugenio Garza Sada 2501, Monterrey 64849, NL, Mexico
[3] Univ Corsica, Lab Sci Environm, Campus Grimaldi BP 52, F-20250 Corte, France
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 25期
关键词
Image fusion; Fire; Wildfires; Deep learning; Visible; Infrared; COMPUTER VISION; NETWORK;
D O I
10.1007/s00521-021-06691-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. In this regard, the fusion of thermal and visible information into a single image can potentially increase the robustness and accuracy of wildfire detection models. In the field of visible-infrared image fusion, there is a growing interest in Deep Learning (DL)-based image fusion techniques due to their reduced complexity; however, the most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. In the present work, we select three state-of-the-art (SOTA) DL-based image fusion techniques and evaluate them for the specific task of fire image fusion, and compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared and fused images.
引用
收藏
页码:18201 / 18213
页数:13
相关论文
共 50 条
  • [31] A novel deep learning-based chemical image identification method of infrared spectroscopy using external perturbation
    Sun, Xiting
    Yuan, Hongfu
    Song, Chunfeng
    Lia, Xiaoyu
    Hu, Aiqin
    ANALYTICAL METHODS, 2020, 12 (10) : 1311 - 1315
  • [32] Decision-Level Fusion Tracking for Infrared and Visible Spectra Based on Deep Learning
    Tang Cong
    Ling Yongshun
    Yang Hua
    Yang Xing
    Tong Wuqin
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (07)
  • [33] Novel infrared and visible image fusion method based on independent component analysis
    Yin Lu
    Fuxiang Wang
    Xiaoyan Luo
    Feng Liu
    Frontiers of Computer Science, 2014, 8 : 243 - 254
  • [34] Novel infrared and visible image fusion method based on independent component analysis
    Lu, Yin
    Wang, Fuxiang
    Luo, Xiaoyan
    Liu, Feng
    FRONTIERS OF COMPUTER SCIENCE, 2014, 8 (02) : 243 - 254
  • [35] A novel motor imagery EEG recognition method based on deep learning
    Li, Ming-ai
    Zhang, Meng
    Sun, Yan-jun
    PROCEEDINGS OF THE 2016 INTERNATIONAL FORUM ON MANAGEMENT, EDUCATION AND INFORMATION TECHNOLOGY APPLICATION, 2016, 47 : 728 - 733
  • [36] A task decoupled framework for enhancing the deep learning-based spatiotemporal fusion method
    Guo, Dizhou
    Shi, Wenzhong
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (13) : 4163 - 4189
  • [37] Deep Learning-Based Outdoor Object Detection Using Visible and Near-Infrared Spectrum
    Bhowmick, Shubhadeep
    Kuiry, Somenath
    Das, Alaka
    Das, Nibaran
    Nasipuri, Mita
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (07) : 9385 - 9402
  • [38] Deep Learning-Based Outdoor Object Detection Using Visible and Near-Infrared Spectrum
    Shubhadeep Bhowmick
    Somenath Kuiry
    Alaka Das
    Nibaran Das
    Mita Nasipuri
    Multimedia Tools and Applications, 2022, 81 : 9385 - 9402
  • [39] Deep Learning-based Marine Target Detection Method with Multiple Feature Fusion
    Wang X.
    Wang Y.
    Chen X.
    Zang C.
    Cui G.
    Journal of Radars, 2024, 13 (03) : 554 - 564
  • [40] HSILDNet: A Novel Deep Learning-based Method for Cervical Lesions Detection
    Cao, Yuzhen
    Ma, Huizhan
    Fan, Yinuo
    Liu, Yuzhen
    Wang, Shuo
    Yu, Hui
    2022 9TH INTERNATIONAL CONFERENCE ON BIOMEDICAL AND BIOINFORMATICS ENGINEERING, ICBBE 2022, 2022, : 35 - 40