FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

被引:22
|
作者
Ciprian-Sanchez, J. F. [1 ]
Ochoa-Ruiz, G. [2 ]
Gonzalez-Mendoza, M. [2 ]
Rossi, L. [3 ]
机构
[1] Tecnol Monterrey, Sch Engn & Sci, Av Lago Guadalupe KM 3-5, Margarita Maza De Juarez 52926, Cd Lopez Mateos, Mexico
[2] Tecnol Monterrey, Sch Engn & Sci, Av Eugenio Garza Sada 2501, Monterrey 64849, NL, Mexico
[3] Univ Corsica, Lab Sci Environm, Campus Grimaldi BP 52, F-20250 Corte, France
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 25期
关键词
Image fusion; Fire; Wildfires; Deep learning; Visible; Infrared; COMPUTER VISION; NETWORK;
D O I
10.1007/s00521-021-06691-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. In this regard, the fusion of thermal and visible information into a single image can potentially increase the robustness and accuracy of wildfire detection models. In the field of visible-infrared image fusion, there is a growing interest in Deep Learning (DL)-based image fusion techniques due to their reduced complexity; however, the most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. In the present work, we select three state-of-the-art (SOTA) DL-based image fusion techniques and evaluate them for the specific task of fire image fusion, and compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared and fused images.
引用
收藏
页码:18201 / 18213
页数:13
相关论文
共 50 条
  • [41] A fusion method for visible and infrared images based on contrast pyramid with teaching learning based optimization
    Jin, Haiyan
    Wang, Yanyan
    INFRARED PHYSICS & TECHNOLOGY, 2014, 64 : 134 - 142
  • [42] An Improved Infrared and Visible Image Fusion Using an Adaptive Contrast Enhancement Method and Deep Learning Network with Transfer Learning
    Bhutto, Jameel Ahmed
    Tian, Lianfang
    Du, Qiliang
    Sun, Zhengzheng
    Yu, Lubin
    Soomro, Toufique Ahmed
    REMOTE SENSING, 2022, 14 (04)
  • [43] Deep Learning-Based Design Method for Acoustic Metasurface Dual-Feature Fusion
    Lv, Qiang
    Zhao, Huanlong
    Huang, Zhen
    Hao, Guoqiang
    Chen, Wei
    MATERIALS, 2024, 17 (09)
  • [44] An Integrated Deep Learning-Based Data Fusion and Degradation Modeling Method for Improving Prognostics
    Wang, Di
    Liu, Kaibo
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (02) : 1713 - 1726
  • [45] A fusion method for infrared-visible image and infrared-polarization image based on multi-scale center-surround top-hat transform
    Zhu, Pan
    Huang, Zhanhua
    OPTICAL REVIEW, 2017, 24 (03) : 370 - 382
  • [46] A deep learning-based attribute adaptive infrared maritime ship target detection method
    Wu, Yi
    Xu, Chuangang
    Li, Ting
    Yao, Keming
    Han, Bing
    AOPC 2020: INFRARED DEVICE AND INFRARED TECHNOLOGY, 2020, 11563
  • [47] A deep learning-based detection method for pig body temperature using infrared thermography
    Xie, Qiuju
    Wu, Mengru
    Bao, Jun
    Zheng, Ping
    Liu, Wenyang
    Liu, Xuefei
    Yu, Haiming
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 213
  • [48] A Novel Deep Learning Scheme for Motor Imagery EEG Decoding Based on Spatial Representation Fusion
    Yang, Jun
    Ma, Zhengmin
    Wang, Jin
    Fu, Yunfa
    IEEE ACCESS, 2020, 8 : 202100 - 202110
  • [49] RealFusion: A reliable deep learning-based spatiotemporal fusion framework for generating seamless fine-resolution imagery
    Guo, Dizhou
    Li, Zhenhong
    Gao, Xu
    Gao, Meiling
    Yu, Chen
    Zhang, Chenglong
    Shi, Wenzhong
    REMOTE SENSING OF ENVIRONMENT, 2025, 321
  • [50] A Study of Novel Initial Fire Detection Algorithm Based on Deep Learning Method
    Yu, Raehyun
    Kim, Kyungho
    JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2024, 19 (06) : 3675 - 3686