Multi-feature contrastive learning for unpaired image-to-image translation

被引:0
|
作者
Yao Gou
Min Li
Yu Song
Yujie He
Litao Wang
机构
[1] Xi’an High-Tech Research Institute,
来源
关键词
Generative model; Image translation; Contrastive learning; Multi-feature; [inline-graphic not available: see fulltext];
D O I
暂无
中图分类号
学科分类号
摘要
Unpaired image-to-image translation for the generation field has made much progress recently. However, these methods suffer from mode collapse because of the overfitting of the discriminator. To this end, we propose a straightforward method to construct a contrastive loss using the feature information of the discriminator output layer, which is named multi-feature contrastive learning (MCL). Our proposed method enhances the performance of the discriminator and solves the problem of model collapse by further leveraging contrastive learning. We perform extensive experiments on several open challenge datasets. Our method achieves state-of-the-art results compared with current methods. Finally, a series of ablation studies proved that our approach has better stability. In addition, our proposed method is also practical for single image translation tasks. Code is available at https://github.com/gouayao/MCL.
引用
收藏
页码:4111 / 4122
页数:11
相关论文
共 50 条
  • [31] UNPAIRED IMAGE-TO-IMAGE SHAPE TRANSLATION ACROSS FASHION DATA
    Wang, Kaili
    Ma, Liqian
    Oramas, Jose M.
    Van Gool, Luc
    Tuytelaars, Tinne
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 206 - 210
  • [32] Multi-head mutual-attention CycleGAN for unpaired image-to-image translation
    Ji, Wei
    Guo, Jing
    Li, Yun
    [J]. IET IMAGE PROCESSING, 2020, 14 (11) : 2395 - 2402
  • [33] Weakly Supervised Learning for Transmission Line Detection Using Unpaired Image-to-Image Translation
    Choi, Jiho
    Lee, Sang Jun
    [J]. REMOTE SENSING, 2022, 14 (14)
  • [34] UNPAIRED IMAGE-TO-IMAGE TRANSLATION FROM SHARED DEEP SPACE
    Wu, Xuehui
    Shao, Jie
    Gao, Lianli
    Shen, Heng Tao
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2127 - 2131
  • [35] Augmented Cyclic Consistency Regularization for Unpaired Image-to-Image Translation
    Ohkawa, Takehiko
    Inoue, Naoto
    Kataoka, Hirokatsu
    Inoue, Nakamasa
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 362 - 369
  • [36] Holographic reconstruction enhancement via unpaired image-to-image translation
    Scherrer, Romane
    Selmaoui-folcher, Nazha
    Quiniou, Thomas
    Jauffrais, Thierry
    Lemonnier, Hugues
    Bonnet, Sophie
    [J]. APPLIED OPTICS, 2022, 61 (33) : 9807 - 9816
  • [37] Cross-Domain Interpolation for Unpaired Image-to-Image Translation
    Lopez, Jorge
    Mauricio, Antoni
    Diaz, Jose
    Camara, Guillermo
    [J]. COMPUTER VISION SYSTEMS (ICVS 2019), 2019, 11754 : 542 - 551
  • [38] Unpaired Image-to-Image Translation via Latent Energy Transport
    Zhao, Yang
    Chen, Changyou
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16413 - 16422
  • [39] Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translation
    Xu, Yanwu
    Xie, Shaoan
    Wu, Wenhao
    Zhang, Kun
    Gong, Mingming
    Batmanghelich, Kayhan
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18290 - 18299
  • [40] One-to-one Mapping for Unpaired Image-to-image Translation
    Shen, Zengming
    Chen, Yifan
    Huang, Thomas S.
    Zhou, S. Kevin
    Georgescu, Bogdan
    Liu, Xuqi
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 1159 - 1168