Infrared Image Generation Based on Visual State Space and Contrastive Learning

被引:0
|
作者
Li, Bing [1 ]
Ma, Decao [1 ]
He, Fang [1 ]
Zhang, Zhili [1 ]
Zhang, Daqiao [1 ]
Li, Shaopeng [1 ,2 ]
机构
[1] Xian Res Inst High Technol, Xian 710025, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
visual state space; contrastive learning; generative adversarial network; visible-to-infrared image translation;
D O I
10.3390/rs16203817
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The preparation of infrared reference images is of great significance for improving the accuracy and precision of infrared imaging guidance. However, collecting infrared data on-site is difficult and time-consuming. Fortunately, the infrared images can be obtained from the corresponding visible-light images to enrich the infrared data. To this end, this present work proposes an image translation algorithm that converts visible-light images to infrared images. This algorithm, named V2IGAN, is founded on the visual state space attention module and multi-scale feature contrastive learning loss. Firstly, we introduce a visual state space attention module designed to sharpen the generative network's focus on critical regions within visible-light images. This enhancement not only improves feature extraction but also bolsters the generator's capacity to accurately model features, ultimately enhancing the quality of generated images. Furthermore, the method incorporates a multi-scale feature contrastive learning loss function, which serves to bolster the robustness of the model and refine the detail of the generated images. Experimental results show that the V2IGAN method outperforms existing typical infrared image generation techniques in both subjective visual assessments and objective metric evaluations. This suggests that the V2IGAN method is adept at enhancing the feature representation in images, refining the details of the generated infrared images, and yielding reliable, high-quality results.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Contrastive Learning based Semantic Communication for Wireless Image Transmission
    Tang, Shunpu
    Yang, Qianqian
    Fan, Lisheng
    Lei, Xianfu
    Deng, Yansha
    Nallanathan, Arumugam
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [42] Infrared sequence image generation of point target in deep space
    Research Center of Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China
    Guangxue Jingmi Gongcheng, 2009, 12 (3062-3068):
  • [43] Classification Based on Hyperspectral Image and LiDAR Data with Contrastive Learning
    Li Shihan
    Hua Haiyang
    Zhang Hao
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (22)
  • [44] Continuous image anomaly detection based on contrastive lifelong learning
    Fan, Wentao
    Shangguan, Weimin
    Bouguila, Nizar
    APPLIED INTELLIGENCE, 2023, 53 (14) : 17693 - 17707
  • [45] Renal Pathological Image Classification Based on Contrastive and Transfer Learning
    Liu, Xinkai
    Zhu, Xin
    Tian, Xingjian
    Iwasaki, Tsuyoshi
    Sato, Atsuya
    Kazama, Junichiro James
    ELECTRONICS, 2024, 13 (07)
  • [46] Supervised Contrastive Learning-Based Classification for Hyperspectral Image
    Huang, Lingbo
    Chen, Yushi
    He, Xin
    Ghamisi, Pedram
    REMOTE SENSING, 2022, 14 (21)
  • [47] Soft Contrastive Learning for Visual Localization
    Thoma, Janine
    Paudel, Danda Pani
    Van Gool, Luc
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [48] Image-Guided Augmentation Visual Question Answering Model Combined with Contrastive Learning
    Yang, You
    Yao, Lu
    Computer Engineering and Applications, 2024, 60 (07) : 157 - 166
  • [49] Low-light image enhancement via Clustering Contrastive Learning for visual recognition
    Sheng, Guanglei
    Hu, Gang
    Wang, Xiaofeng
    Chen, Wei
    Jiang, Jinlin
    PATTERN RECOGNITION, 2025, 164
  • [50] Infrared Image Generation Based on Improved CycleGAN
    Liu, Xinyi
    Liu, Yu
    Zhang, Zheng
    Zhang, Maojun
    2024 10TH INTERNATIONAL CONFERENCE ON BIG DATA AND INFORMATION ANALYTICS, BIGDIA 2024, 2024, : 161 - 166