Multi-feature contrastive learning for unpaired image-to-image translation

被引:0
|
作者
Yao Gou
Min Li
Yu Song
Yujie He
Litao Wang
机构
[1] Xi’an High-Tech Research Institute,
来源
关键词
Generative model; Image translation; Contrastive learning; Multi-feature; [inline-graphic not available: see fulltext];
D O I
暂无
中图分类号
学科分类号
摘要
Unpaired image-to-image translation for the generation field has made much progress recently. However, these methods suffer from mode collapse because of the overfitting of the discriminator. To this end, we propose a straightforward method to construct a contrastive loss using the feature information of the discriminator output layer, which is named multi-feature contrastive learning (MCL). Our proposed method enhances the performance of the discriminator and solves the problem of model collapse by further leveraging contrastive learning. We perform extensive experiments on several open challenge datasets. Our method achieves state-of-the-art results compared with current methods. Finally, a series of ablation studies proved that our approach has better stability. In addition, our proposed method is also practical for single image translation tasks. Code is available at https://github.com/gouayao/MCL.
引用
收藏
页码:4111 / 4122
页数:11
相关论文
共 50 条
  • [1] Multi-feature contrastive learning for unpaired image-to-image translation
    Gou, Yao
    Li, Min
    Song, Yu
    He, Yujie
    Wang, Litao
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4111 - 4122
  • [2] Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation
    Lin, Yupei
    Zhang, Sen
    Chen, Tianshui
    Lu, Yongyi
    Li, Guangping
    Shi, Yukai
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1186 - 1194
  • [3] Multi-attention bidirectional contrastive learning method for unpaired image-to-image translation
    Yang, Benchen
    Liu, Xuzhao
    Li, Yize
    Jin, Haibo
    Qu, Yetian
    [J]. PLOS ONE, 2024, 19 (04):
  • [4] Contrastive learning for unsupervised image-to-image translation
    Lee, Hanbit
    Seol, Jinseok
    Lee, Sang-goo
    Park, Jaehui
    Shim, Junho
    [J]. APPLIED SOFT COMPUTING, 2024, 151
  • [5] Dual Contrastive Learning for Unsupervised Image-to-Image Translation
    Han, Junlin
    Shoeiby, Mehrdad
    Petersson, Lars
    Armin, Mohammad Ali
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 746 - 755
  • [6] Unpaired image-to-image translation with improved two-dimensional feature
    Hangyao Tu
    Wanliang Wang
    Jiachen Chen
    Fei Wu
    Guoqing Li
    [J]. Multimedia Tools and Applications, 2022, 81 : 43851 - 43872
  • [7] Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation
    Wang, Weilun
    Zhou, Wengang
    Bao, Jianmin
    Chen, Dong
    Li, Houqiang
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14000 - 14009
  • [8] Unpaired image-to-image translation with improved two-dimensional feature
    Tu, Hangyao
    Wang, Wanliang
    Chen, Jiachen
    Wu, Fei
    Li, Guoqing
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (30) : 43851 - 43872
  • [9] Random Reconstructed Unpaired Image-to-Image Translation
    Zhang, Xiaoqin
    Fan, Chenxiang
    Xiao, Zhiheng
    Zhao, Li
    Chen, Huiling
    Chang, Xiaojun
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (03) : 3144 - 3154
  • [10] Towards semantically continuous unpaired image-to-image translation via margin adaptive contrastive learning and wavelet transform
    Zhang, Heng
    Yang, Yi-Jun
    Zeng, Wei
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252