Shortwave infrared and visible light image fusion method based on dual discriminator GAN

被引:1
|
作者
Huang, Pengxing [1 ,2 ]
Liu, Xiaojie [1 ,2 ]
Zhao, Shiqi [1 ,2 ]
Ma, Ruyue [1 ,2 ,3 ]
Dong, Hao [1 ,2 ]
Wang, Chenguang [1 ,2 ,3 ]
Cao, Huiliang [1 ,2 ]
Shen, Chong [1 ,2 ]
机构
[1] North Univ China, State Key Lab Dynam Measurement Technol, Taiyuan 030051, Shanxi, Peoples R China
[2] North Univ China, Shanxi Prov Key Lab Quantum Sensing & Precis Measu, Taiyuan 030051, Shanxi, Peoples R China
[3] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Shanxi, Peoples R China
关键词
image fusion; generative adversarial network; SWIR; SURF; NETWORK;
D O I
10.1088/1402-4896/ad2328
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In a tactical warfare setting, the efficacy of target detection becomes profoundly compromised due to prevalent environmental factors such as smoke, dust, and atmospheric interference. Such impediments invariably undermine the precision and reliability of identifying pivotal targets, thereby precipitating potentially dire ramifications. Remarkably, short-wave infrared technology has exhibited unparalleled proficiency in elucidating target attributes even amidst challenging conditions characterized by smoke, fog, or haze. Against this backdrop, the present study delineates a pioneering algorithmic framework that seamlessly amalgamates the imperatives of image registration and fusion. This is achieved through the deployment of an advanced dual-discriminator Generative Adversarial Network (GAN), specifically tailored for amalgamating short-wave infrared and visible light imagery within smoke-obscured contexts. Our methodology commences with the introduction of an augmented Speeded-Up Robust Features (SURF) algorithm, meticulously designed to rectify inherent misalignments within the input imagery. Subsequent enhancements encompass the refinement of the generator's loss function and the integration of a multi-scale convolutional kernel, thereby facilitating the extraction and amalgamation of a more expansive array of salient features. This concerted effort culminates in the elevation of image fusion quality. To corroborate the efficacy and robustness of our proposed framework, rigorous validation procedures were conducted utilizing a meticulously curated dataset comprising short-wave infrared and visible light images. Empirical evaluations, encompassing both subjective and objective comparative analyses, unequivocally affirm the superior performance metrics of our fusion network. Specifically, our methodology surpasses alternative fusion techniques across multiple dimensions, including visual fidelity, perceptual quality, and structural congruence of synthesized images.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] DDGANA: Dual-discriminator GAN with attention module for infrared and visible image fusion
    Ren, Jinwen
    Wang, Jingjing
    Li, Hongzhen
    Sun, Zengzhao
    Luan, Zhenye
    Yu, Zishu
    Xu, Huaqiang
    Hua, Qing
    2021 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2021, 12076
  • [2] DDGANSE: Dual-Discriminator GAN with a Squeeze-and-Excitation Module for Infrared and Visible Image Fusion
    Wang, Jingjing
    Ren, Jinwen
    Li, Hongzhen
    Sun, Zengzhao
    Luan, Zhenye
    Yu, Zishu
    Liang, Chunhao
    Monfared, Yashar E.
    Xu, Huaqiang
    Hua, Qing
    PHOTONICS, 2022, 9 (03)
  • [3] DUGAN: Infrared and visible image fusion based on dual fusion paths and a U-type discriminator
    Chang, Le
    Huang, Yongdong
    Li, Qiufu
    Zhang, Yuduo
    Liu, Lijun
    Zhou, Qingjian
    NEUROCOMPUTING, 2024, 578
  • [4] Image Fusion Processing Method Based on Infrared and Visible Light
    Lin, Xiaogong
    Yang, Ronghao
    2019 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2019, : 1605 - 1609
  • [5] Semantic-guided polarization image fusion method based on a dual-discriminator GAN
    Liu, Ju
    Duan, Jin
    Hao, Youfei
    Chen, Guangqiu
    Zhang, Hao
    OPTICS EXPRESS, 2022, 30 (24) : 43601 - 43621
  • [6] Illumination enhancement discriminator and compensation attention based low-light visible and infrared image fusion
    Zhang, Xingfei
    Liu, Gang
    Wang, Gaoqiang
    Bavirisetti, Durga Prasad
    OPTICS AND LASERS IN ENGINEERING, 2025, 185
  • [7] A GAN-based visible and infrared image fusion algorithm
    Zhang, Hongzhi
    Shen, Yifan
    Ou, Yangyan
    Ji, Bo
    He, Jia
    AOPC 2021: INFRARED DEVICE AND INFRARED TECHNOLOGY, 2021, 12061
  • [8] Infrared and visible image fusion method of dual NSCT and PCNN
    Wu, Chunming
    Chen, Long
    PLOS ONE, 2020, 15 (09):
  • [9] Target interpretation of visible light image and infrared image fusion method
    Sun, Wei
    Xiao, Wen
    Pan, Feng
    Du, Chao
    AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [10] Infrared and Visible Image Fusion Method Based on Dual path Cascade Adversarial Mechanism
    Tang Lili
    Liu Gang
    Xiao Gang
    ACTA PHOTONICA SINICA, 2021, 50 (09) : 313 - 323