Asymmetric slack contrastive learning for full use of feature information in image translation

被引:0
|
作者
Zhang, Yusen [1 ]
Li, Min [1 ]
Gou, Yao [1 ]
He, Yujie [1 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Shaanxi, Peoples R China
关键词
Image translation; Cross-domain learning; Asymmetric slack contrast; Contrastive learning; Structure consistency;
D O I
10.1016/j.knosys.2024.112136
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, contrastive learning has been proven to be powerful in cross -domain feature learning and has been widely used in image translation tasks. However, these methods often overlook the differences between positive and negative samples regarding model optimization ability and treat them equally. This weakens the feature representation ability of the generative models. In this paper, we propose a novel image translation model based on asymmetric slack contrastive learning. We design a new contrastive loss asymmetrically by introducing a slack adjustment factor. Theoretical analysis shows that it can adaptively optimize and adjust according to different positive and negative samples and significantly improve optimization efficiency. In addition, to better preserve local structural relationships during image translation, we constructed a regional differential structural consistency correction block using differential vectors. Comparative experiments were conducted using seven existing methods on five datasets. The results indicate that our method can maintain structural consistency between cross -domain images at a deeper level. Furthermore, it is more effective in establishing real image -domain mapping relations, resulting in higher -quality images being generated.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Feature-Contrastive Graph Federated Learning: Responsible AI in Graph Information Analysis
    Zeng, Xingjie
    Zhou, Tao
    Bao, Zhicheng
    Zhao, Hongwei
    Chen, Leiming
    Wang, Xiao
    Wang, Feiyue
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (06) : 2938 - 2948
  • [32] Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation
    Wang, Weilun
    Zhou, Wengang
    Bao, Jianmin
    Chen, Dong
    Li, Houqiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14000 - 14009
  • [33] Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning
    Zhao L.
    Zhang H.
    Xing W.
    Lin Z.
    Lin H.
    Lu D.
    Pan X.
    Xu D.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (04): : 930 - 946
  • [34] Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profile
    Lee, Seokjun
    Jung, Seung-Won
    Seo, Hyunseok
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 2929 - 2937
  • [35] Bidirectional feature matching based on deep pairwise contrastive learning for multiparametric MRI image synthesis
    Touati, Redha
    Kadoury, Samuel
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (12):
  • [36] Multimodal Contrastive Learning for Remote Sensing Image Feature Extraction Based on Relaxed Positive Samples
    Zhang, Zhenshi
    Li, Qiujun
    Jing, Wenxuan
    He, Guangjun
    Zhu, Lili
    Gao, Shijuan
    SENSORS, 2024, 24 (23)
  • [37] Self-Supervised Feature Representation for SAR Image Target Classification Using Contrastive Learning
    Pei, Hao
    Su, Mingjie
    Xu, Gang
    Xing, Mengdao
    Hong, Wei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 9461 - 9473
  • [38] Towards semantically continuous unpaired image-to-image translation via margin adaptive contrastive learning and wavelet transform
    Zhang, Heng
    Yang, Yi-Jun
    Zeng, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [39] Enhancing Hyperspectral Image Classification: Leveraging Unsupervised Information With Guided Group Contrastive Learning
    Li, Ben
    Fang, Leyuan
    Chen, Ning
    Kang, Jitong
    Yue, Jun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17
  • [40] DAS-CL: Towards Multimodal Machine Translation via Dual-Level Asymmetric Contrastive Learning
    Cheng, Xuxin
    Zhu, Zhihong
    Li, Yaowei
    Li, Hongxiang
    Zou, Yuexian
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 337 - 347