Asymmetric slack contrastive learning for full use of feature information in image translation

被引:0
|
作者
Zhang, Yusen [1 ]
Li, Min [1 ]
Gou, Yao [1 ]
He, Yujie [1 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Shaanxi, Peoples R China
关键词
Image translation; Cross-domain learning; Asymmetric slack contrast; Contrastive learning; Structure consistency;
D O I
10.1016/j.knosys.2024.112136
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, contrastive learning has been proven to be powerful in cross -domain feature learning and has been widely used in image translation tasks. However, these methods often overlook the differences between positive and negative samples regarding model optimization ability and treat them equally. This weakens the feature representation ability of the generative models. In this paper, we propose a novel image translation model based on asymmetric slack contrastive learning. We design a new contrastive loss asymmetrically by introducing a slack adjustment factor. Theoretical analysis shows that it can adaptively optimize and adjust according to different positive and negative samples and significantly improve optimization efficiency. In addition, to better preserve local structural relationships during image translation, we constructed a regional differential structural consistency correction block using differential vectors. Comparative experiments were conducted using seven existing methods on five datasets. The results indicate that our method can maintain structural consistency between cross -domain images at a deeper level. Furthermore, it is more effective in establishing real image -domain mapping relations, resulting in higher -quality images being generated.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Unsupervised CD in Satellite Image Time Series by Contrastive Learning and Feature Tracking
    Chen, Yuxing
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 13
  • [22] Remote sensing image feature extraction and classification based on contrastive learning method
    Mu X.-D.
    Bai K.
    You X.-A.
    Zhu Y.-Q.
    Chen X.-B.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (09): : 2222 - 2234
  • [23] Contrastive Learning of Multimodal Consistency Feature Representation for Remote Sensing Image Registration
    Han, Zhen
    Lv, Ning
    Wang, Zhiyi
    Han, Wei
    Cong, Li
    Wan, Shaohua
    Chen, Chen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 10740 - 10751
  • [24] Multi-modal degradation feature learning for unified image restoration based on contrastive learning
    Chen, Lei
    Xiong, Qingbo
    Zhang, Wei
    Liang, Xiaoli
    Gan, Zhihua
    Li, Liqiang
    He, Xin
    NEUROCOMPUTING, 2025, 616
  • [25] Aerospace information acquisition and image generation based on supervised contrastive learning
    Qi Yi-chen
    Zhao Wei-chao
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (11) : 1531 - 1541
  • [26] Cross-similarity guided contrastive learning for infrared-visible image-to-image translation
    Yu, Pan
    Zhao, Wei
    Huang, Yan
    Wang, Guoyou
    Proceedings of SPIE - The International Society for Optical Engineering, 2024, 13180
  • [27] Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Tasks
    Jung, Chanyong
    Kwon, Gihyun
    Ye, Jong Chul
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18239 - 18248
  • [28] Modal Contrastive Learning Based End-to-End Text Image Machine Translation
    Ma, Cong
    Han, Xu
    Wu, Linghui
    Zhang, Yaping
    Zhao, Yang
    Zhou, Yu
    Zong, Chengqing
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 2153 - 2165
  • [29] UCGAN: a contrastive learning-based unaligned image translation model with importance reweighting
    Wang, Shibin
    Zhang, Shiying
    Liu, Dong
    Zhong, Jinghui
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [30] Graph Information Interaction on Feature and Structure via Cross-modal Contrastive Learning
    Wen, Jinyong
    Wang, Yuhu
    Zhang, Chunxia
    Xiang, Shiming
    Pan, Chunhong
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1068 - 1073