Multi-feature contrastive learning for unpaired image-to-image translation

被引:0
|
作者
Yao Gou
Min Li
Yu Song
Yujie He
Litao Wang
机构
[1] Xi’an High-Tech Research Institute,
来源
关键词
Generative model; Image translation; Contrastive learning; Multi-feature; [inline-graphic not available: see fulltext];
D O I
暂无
中图分类号
学科分类号
摘要
Unpaired image-to-image translation for the generation field has made much progress recently. However, these methods suffer from mode collapse because of the overfitting of the discriminator. To this end, we propose a straightforward method to construct a contrastive loss using the feature information of the discriminator output layer, which is named multi-feature contrastive learning (MCL). Our proposed method enhances the performance of the discriminator and solves the problem of model collapse by further leveraging contrastive learning. We perform extensive experiments on several open challenge datasets. Our method achieves state-of-the-art results compared with current methods. Finally, a series of ablation studies proved that our approach has better stability. In addition, our proposed method is also practical for single image translation tasks. Code is available at https://github.com/gouayao/MCL.
引用
收藏
页码:4111 / 4122
页数:11
相关论文
共 50 条
  • [41] One-to-one Mapping for Unpaired Image-to-image Translation
    Shen, Zengming
    Chen, Yifan
    Huang, Thomas S.
    Zhou, S. Kevin
    Georgescu, Bogdan
    Liu, Xuqi
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 1159 - 1168
  • [42] DehazeGAN: Underwater Haze Image Restoration using Unpaired Image-to-image Translation
    Cho, Younggun
    Malav, Ramavtar
    Pandey, Gaurav
    Kim, Ayoung
    [J]. IFAC PAPERSONLINE, 2019, 52 (21): : 82 - 85
  • [43] Deliberation Learning for Image-to-Image Translation
    He, Tianyu
    Xia, Yingce
    Lin, Jianxin
    Tan, Xu
    He, Di
    Qin, Tao
    Chen, Zhibo
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2484 - 2490
  • [44] Edge-guided Adversarial Network Based on Contrastive Learning for Image-to-Image Translation
    Zhu, Chen
    Lai, Ru
    Bi, Luzheng
    Wang, Xuyang
    Du, Jiarong
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7949 - 7954
  • [45] Deep learning based unpaired image-to-image translation applications for medical physics: a systematic review
    Chen, Junhua
    Chen, Shenlun
    Wee, Leonard
    Dekker, Andre
    Bermejo, Inigo
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (05):
  • [46] Asynchronous Generative Adversarial Network for Asymmetric Unpaired Image-to-Image Translation
    Zheng, Ziqiang
    Bin, Yi
    Lv, Xiaoou
    Wu, Yang
    Yang, Yang
    Shen, Heng Tao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2474 - 2487
  • [47] GAN-based unpaired image-to-image translation for maritime imagery
    Mediavilla, Chelsea
    Sato, Jonathan
    Manzanares, Mitch
    Dotter, Marissa
    Parameswaran, Shibin
    [J]. GEOSPATIAL INFORMATICS X, 2020, 11398
  • [48] Enhanced Unpaired Image-to-Image Translation via Transformation in Saliency Domain
    Shibasaki, Kei
    Ikehara, Masaaki
    [J]. IEEE ACCESS, 2023, 11 : 137495 - 137505
  • [49] Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation
    Pizzati, Fabio
    de Charette, Raoul
    Zaccaria, Michela
    Cerri, Pietro
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2979 - 2987
  • [50] Trans-Cycle: Unpaired Image-to-Image Translation Network by Transformer
    Tian, Kai
    Pan, Mengze
    Lu, Zongqing
    Liao, Qingmin
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 576 - 587