Infrared Image Generation Based on Visual State Space and Contrastive Learning

被引:0
|
作者
Li, Bing [1 ]
Ma, Decao [1 ]
He, Fang [1 ]
Zhang, Zhili [1 ]
Zhang, Daqiao [1 ]
Li, Shaopeng [1 ,2 ]
机构
[1] Xian Res Inst High Technol, Xian 710025, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
visual state space; contrastive learning; generative adversarial network; visible-to-infrared image translation;
D O I
10.3390/rs16203817
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The preparation of infrared reference images is of great significance for improving the accuracy and precision of infrared imaging guidance. However, collecting infrared data on-site is difficult and time-consuming. Fortunately, the infrared images can be obtained from the corresponding visible-light images to enrich the infrared data. To this end, this present work proposes an image translation algorithm that converts visible-light images to infrared images. This algorithm, named V2IGAN, is founded on the visual state space attention module and multi-scale feature contrastive learning loss. Firstly, we introduce a visual state space attention module designed to sharpen the generative network's focus on critical regions within visible-light images. This enhancement not only improves feature extraction but also bolsters the generator's capacity to accurately model features, ultimately enhancing the quality of generated images. Furthermore, the method incorporates a multi-scale feature contrastive learning loss function, which serves to bolster the robustness of the model and refine the detail of the generated images. Experimental results show that the V2IGAN method outperforms existing typical infrared image generation techniques in both subjective visual assessments and objective metric evaluations. This suggests that the V2IGAN method is adept at enhancing the feature representation in images, refining the details of the generated infrared images, and yielding reliable, high-quality results.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] Aerospace information acquisition and image generation based on supervised contrastive learning
    Qi Yi-chen
    Zhao Wei-chao
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (11) : 1531 - 1541
  • [2] Image Generation using EEG data: A Contrastive Learning based Approach
    Sugimoto, Yuma
    Pongthanisorn, Goragod
    Capi, Genci
    2024 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE 2024, 2024, : 794 - 798
  • [3] Diversity Learning Based on Multi-Latent Space for Medical Image Visual Question Generation
    Zhu, He
    Togo, Ren
    Ogawa, Takahiro
    Haseyama, Miki
    SENSORS, 2023, 23 (03)
  • [4] A Contrastive Learning Approach for Infrared-Visible Image Fusion
    Gupta, Ashish Kumar
    Barnwal, Meghna
    Mishra, Deepak
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2023, 2023, 14301 : 199 - 208
  • [5] Contrastive Learning for Image Registration in Visual Teach and Repeat Navigation
    Rozsypalek, Zdenek
    Broughton, George
    Linder, Pavel
    Roucek, Tomas
    Blaha, Jan
    Mentzl, Leonard
    Kusumam, Keerthy
    Krajnik, Tomas
    SENSORS, 2022, 22 (08)
  • [6] ISAR Image Segmentation for Space Target Based on Contrastive Learning and NL-Unet
    Kou, Peng
    Qiu, Xiangfeng
    Liu, Yongxiang
    Zhao, Dongjie
    Li, Weijie
    Zhang, Shuanghui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [7] Unified Contrastive Learning in Image-Text-Label Space
    Yang, Jianwei
    Li, Chunyuan
    Zhang, Pengchuan
    Xiao, Bin
    Liu, Ce
    Yuan, Lu
    Gao, Jianfeng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 19141 - 19151
  • [8] Infrared Image Recognition Technology Based on Visual Processing and Deep Learning
    He Feng
    Hu Xuran
    Liu Bin
    Wang Haipeng
    Zhang Decai
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 641 - 645
  • [9] Few-shot image generation with reverse contrastive learning
    Gou, Yao
    Li, Min
    Zhang, Yusen
    He, Zhuzhen
    He, Yujie
    NEURAL NETWORKS, 2024, 169 : 154 - 164
  • [10] Near-Infrared Image Colorization Using Unsupervised Contrastive Learning
    Rao, Devesh
    Jayaraj, P. B.
    Pournami, P. N.
    COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT I, 2024, 2009 : 50 - 61