Shortwave infrared and visible light image fusion method based on dual discriminator GAN

被引:1
|
作者
Huang, Pengxing [1 ,2 ]
Liu, Xiaojie [1 ,2 ]
Zhao, Shiqi [1 ,2 ]
Ma, Ruyue [1 ,2 ,3 ]
Dong, Hao [1 ,2 ]
Wang, Chenguang [1 ,2 ,3 ]
Cao, Huiliang [1 ,2 ]
Shen, Chong [1 ,2 ]
机构
[1] North Univ China, State Key Lab Dynam Measurement Technol, Taiyuan 030051, Shanxi, Peoples R China
[2] North Univ China, Shanxi Prov Key Lab Quantum Sensing & Precis Measu, Taiyuan 030051, Shanxi, Peoples R China
[3] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Shanxi, Peoples R China
关键词
image fusion; generative adversarial network; SWIR; SURF; NETWORK;
D O I
10.1088/1402-4896/ad2328
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In a tactical warfare setting, the efficacy of target detection becomes profoundly compromised due to prevalent environmental factors such as smoke, dust, and atmospheric interference. Such impediments invariably undermine the precision and reliability of identifying pivotal targets, thereby precipitating potentially dire ramifications. Remarkably, short-wave infrared technology has exhibited unparalleled proficiency in elucidating target attributes even amidst challenging conditions characterized by smoke, fog, or haze. Against this backdrop, the present study delineates a pioneering algorithmic framework that seamlessly amalgamates the imperatives of image registration and fusion. This is achieved through the deployment of an advanced dual-discriminator Generative Adversarial Network (GAN), specifically tailored for amalgamating short-wave infrared and visible light imagery within smoke-obscured contexts. Our methodology commences with the introduction of an augmented Speeded-Up Robust Features (SURF) algorithm, meticulously designed to rectify inherent misalignments within the input imagery. Subsequent enhancements encompass the refinement of the generator's loss function and the integration of a multi-scale convolutional kernel, thereby facilitating the extraction and amalgamation of a more expansive array of salient features. This concerted effort culminates in the elevation of image fusion quality. To corroborate the efficacy and robustness of our proposed framework, rigorous validation procedures were conducted utilizing a meticulously curated dataset comprising short-wave infrared and visible light images. Empirical evaluations, encompassing both subjective and objective comparative analyses, unequivocally affirm the superior performance metrics of our fusion network. Specifically, our methodology surpasses alternative fusion techniques across multiple dimensions, including visual fidelity, perceptual quality, and structural congruence of synthesized images.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Infrared and visible light image fusion based on convolution and self attention
    Chen, Xiaoxuan
    Xu, Shuwen
    Hu, Shaohai
    Ma, Xiaole
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2024, 46 (08): : 2641 - 2649
  • [32] Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image
    Zhang, Yugui
    Zhai, Bo
    Wang, Gang
    Lin, Jianchu
    ELECTRONICS, 2023, 12 (14)
  • [33] Structural similarity preserving GAN for infrared and visible image fusion
    Zhang, Di
    Zhou, Yong
    Zhao, Jiaqi
    Zhou, Ziyuan
    Yao, Rui
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2021, 19 (01)
  • [34] GAN-HA: A generative adversarial network with a novel heterogeneous dual-discriminator network and a new attention-based fusion strategy for infrared and visible fusion
    Lu, Guosheng
    Fang, Zile
    Tian, Jiaju
    Huang, Haowen
    Xu, Yuelong
    Han, Zhuolin
    Kang, Yaoming
    Feng, Can
    Zhao, Zhigang
    INFRARED PHYSICS & TECHNOLOGY, 2024, 142
  • [35] FusionOC: Research on optimal control method for infrared and visible light image fusion
    Dong, Linlu
    Wang, Jun
    NEURAL NETWORKS, 2025, 181
  • [36] AN IMPROVED FUSION METHOD FOR INFRARED AND LOW-LIGHT LEVEL VISIBLE IMAGE
    Wu, Ruiqing
    Yu, Dayan
    Liu, Jian
    Wu, Hao
    Chen, Wei
    Gu, Qingshui
    2017 14TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2017, : 147 - 151
  • [37] An Infrared and Visible Image Fusion Algorithm Method Based on a Dual Bilateral Least Squares Hybrid Filter
    Lu, Quan
    Han, Zhuangding
    Hu, Likun
    Tian, Feiyu
    ELECTRONICS, 2023, 12 (10)
  • [38] Research on fusion technology based on low-light visible image and infrared image
    Liu, Shuo
    Piao, Yan
    Tahir, Muhammad
    OPTICAL ENGINEERING, 2016, 55 (12)
  • [39] HaarFuse: A dual-branch infrared and visible light image fusion network based on Haar wavelet transform
    Wang, Yuequn
    Liu, Jie
    Wang, Jianli
    Yang, Leqiang
    Dong, Bo
    Li, Zhengwei
    PATTERN RECOGNITION, 2025, 164
  • [40] A Noisy Infrared and Visible Light Image Fusion Algorithm
    Shen, Yu
    Xiang, Keyun
    Chen, Xiaopeng
    Liu, Cheng
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2021, 17 (05): : 1004 - 1019