Asymmetric slack contrastive learning for full use of feature information in image translation

被引:0
|
作者
Zhang, Yusen [1 ]
Li, Min [1 ]
Gou, Yao [1 ]
He, Yujie [1 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Shaanxi, Peoples R China
关键词
Image translation; Cross-domain learning; Asymmetric slack contrast; Contrastive learning; Structure consistency;
D O I
10.1016/j.knosys.2024.112136
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, contrastive learning has been proven to be powerful in cross -domain feature learning and has been widely used in image translation tasks. However, these methods often overlook the differences between positive and negative samples regarding model optimization ability and treat them equally. This weakens the feature representation ability of the generative models. In this paper, we propose a novel image translation model based on asymmetric slack contrastive learning. We design a new contrastive loss asymmetrically by introducing a slack adjustment factor. Theoretical analysis shows that it can adaptively optimize and adjust according to different positive and negative samples and significantly improve optimization efficiency. In addition, to better preserve local structural relationships during image translation, we constructed a regional differential structural consistency correction block using differential vectors. Comparative experiments were conducted using seven existing methods on five datasets. The results indicate that our method can maintain structural consistency between cross -domain images at a deeper level. Furthermore, it is more effective in establishing real image -domain mapping relations, resulting in higher -quality images being generated.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] FULL POLARIZATION SAR IMAGE CLASSIFICATION USING DEEP LEARNING WITH SHALLOW FEATURE
    Li, Debo
    Gu, Yu
    Gou, Shuiping
    Jiao, Licheng
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 4566 - 4569
  • [42] Fast FF-to-FFPE Whole Slide Image Translation via Laplacian Pyramid and Contrastive Learning
    Fan, Lei
    Sowmya, Arcot
    Meijering, Erik
    Song, Yang
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 409 - 419
  • [43] IMPROVING REFERENCE-BASED IMAGE COLORIZATION FOR LINE ARTS VIA FEATURE AGGREGATION AND CONTRASTIVE LEARNING
    Wu, Shukai
    Wang, Qingqin
    Xu, Shuchang
    Zhang, Sanyuan
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4888 - 4892
  • [44] Feature Contrastive Transfer Learning for Few-Shot Long-Tail Sonar Image Classification
    Bai, Zhongyu
    Xu, Hongli
    Ding, Qichuan
    Zhang, Xiangyue
    IEEE COMMUNICATIONS LETTERS, 2025, 29 (03) : 562 - 566
  • [45] Adaptive unified contrastive learning with graph-based feature aggregator for imbalanced medical image classification
    Cong, Cong
    Liu, Sidong
    Rana, Priyanka
    Pagnucco, Maurice
    Di Ieva, Antonio
    Berkovsky, Shlomo
    Song, Yang
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [46] Few鄄Shot Image Classification Based on Local Contrastive Learning and Novel Class Feature Generation
    Chen, Ning
    Liu, Fan
    Dong, Chenwei
    Chen, Zhiyu
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (10): : 936 - 946
  • [47] Learning Agreement Feature Based on an Information Theory for Fundus Image Segmentation
    Yang, Xinbo
    Zhang, Zhijun
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2023, 64 (08)
  • [48] CT Kernel Conversion Using Multi-domain Image-to-Image Translation with Generator-Guided Contrastive Learning
    Choi, Changyong
    Jeong, Jiheon
    Lee, Sangyoon
    Lee, Sang Min
    Kim, Namkug
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 344 - 354
  • [49] An Efficient and Lightweight Spectral-Spatial Feature Graph Contrastive Learning Framework for Hyperspectral Image Clustering
    Yang, Aitao
    Li, Min
    Ding, Yao
    Xiao, Xiongwu
    He, Yujie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [50] Unsupervised Domain Adaptation with Contrastive Learning-Based Discriminative Feature Augmentation for RS Image Classification
    Xu, Ren
    Samat, Alim
    Zhu, Enzhao
    Li, Erzhu
    Li, Wei
    REMOTE SENSING, 2024, 16 (11)