Shortwave infrared and visible light image fusion method based on dual discriminator GAN

被引:1
|
作者
Huang, Pengxing [1 ,2 ]
Liu, Xiaojie [1 ,2 ]
Zhao, Shiqi [1 ,2 ]
Ma, Ruyue [1 ,2 ,3 ]
Dong, Hao [1 ,2 ]
Wang, Chenguang [1 ,2 ,3 ]
Cao, Huiliang [1 ,2 ]
Shen, Chong [1 ,2 ]
机构
[1] North Univ China, State Key Lab Dynam Measurement Technol, Taiyuan 030051, Shanxi, Peoples R China
[2] North Univ China, Shanxi Prov Key Lab Quantum Sensing & Precis Measu, Taiyuan 030051, Shanxi, Peoples R China
[3] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Shanxi, Peoples R China
关键词
image fusion; generative adversarial network; SWIR; SURF; NETWORK;
D O I
10.1088/1402-4896/ad2328
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In a tactical warfare setting, the efficacy of target detection becomes profoundly compromised due to prevalent environmental factors such as smoke, dust, and atmospheric interference. Such impediments invariably undermine the precision and reliability of identifying pivotal targets, thereby precipitating potentially dire ramifications. Remarkably, short-wave infrared technology has exhibited unparalleled proficiency in elucidating target attributes even amidst challenging conditions characterized by smoke, fog, or haze. Against this backdrop, the present study delineates a pioneering algorithmic framework that seamlessly amalgamates the imperatives of image registration and fusion. This is achieved through the deployment of an advanced dual-discriminator Generative Adversarial Network (GAN), specifically tailored for amalgamating short-wave infrared and visible light imagery within smoke-obscured contexts. Our methodology commences with the introduction of an augmented Speeded-Up Robust Features (SURF) algorithm, meticulously designed to rectify inherent misalignments within the input imagery. Subsequent enhancements encompass the refinement of the generator's loss function and the integration of a multi-scale convolutional kernel, thereby facilitating the extraction and amalgamation of a more expansive array of salient features. This concerted effort culminates in the elevation of image fusion quality. To corroborate the efficacy and robustness of our proposed framework, rigorous validation procedures were conducted utilizing a meticulously curated dataset comprising short-wave infrared and visible light images. Empirical evaluations, encompassing both subjective and objective comparative analyses, unequivocally affirm the superior performance metrics of our fusion network. Specifically, our methodology surpasses alternative fusion techniques across multiple dimensions, including visual fidelity, perceptual quality, and structural congruence of synthesized images.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Semantic-Supervised Infrared and Visible Image Fusion Via a Dual-Discriminator Generative Adversarial Network
    Zhou, Huabing
    Wu, Wei
    Zhang, Yanduo
    Ma, Jiayi
    Ling, Haibin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 635 - 648
  • [22] Infrared and visible images fusion method based on image information
    Ma, Donghui
    Xue, Qun
    Chai, Qi
    Ren, Biao
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2011, 40 (06): : 1168 - 1171
  • [23] A Visible and Infrared Image Fusion Method Based on Ghost Imaging
    Ye, Hualong
    JOURNAL OF RUSSIAN LASER RESEARCH, 2023, 44 (06) : 637 - 645
  • [24] Infrared and visible image fusion method based on sparse features
    Ding, Wenshan
    Bi, Duyan
    He, Linyuan
    Fan, Zunlin
    INFRARED PHYSICS & TECHNOLOGY, 2018, 92 : 372 - 380
  • [25] A Visible and Infrared Image Fusion Method Based on Ghost Imaging
    Ye Hualong
    Journal of Russian Laser Research, 2023, 44 (6) : 637 - 645
  • [26] The Infrared and Visible Image Fusion Method Based on Variational Multiscale
    Feng X.
    Zhang J.-H.
    Hu K.-Q.
    Zhai Z.-F.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2018, 46 (03): : 680 - 687
  • [27] Infrared and Visible Image Fusion Method Based on Degradation Model
    Jiang Yichun
    Liu Yunqing
    Zhan Weida
    Zhu Depeng
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (12) : 4405 - 4415
  • [28] Triple-discriminator generative adversarial network for infrared and visible image fusion
    Song, Anyang
    Duan, Huixian
    Pei, Haodong
    Ding, Lei
    NEUROCOMPUTING, 2022, 483 : 183 - 194
  • [29] A Vehicle Target Detection Method Based on Feature Level Fusion of Infrared and Visible Light Image
    Xin, Dong
    Xu, Lixin
    Chen, Huimin
    Yang, Xu
    Zhang, Ruiheng
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 469 - 474
  • [30] Image fusion of ShortWave InfraRed (SWIR) and visible for detection of mines, obstacles and camouflage
    Wolff, LB
    Socolinsky, DA
    Eveland, CK
    Yalcin, JI
    DETECTION AND REMEDIATION TECHNOLOGIES FOR MINES AND MINELIKE TARGETS VIII, PTS 1 AND 2, 2003, 5089 : 1298 - 1306