A Style-aware Discriminator for Controllable Image Translation

被引:17
|
作者
Kim, Kunhee [1 ]
Park, Sanghun [1 ]
Jeon, Eunyeong [1 ]
Kim, Taehun [1 ]
Kim, Daijin [1 ]
机构
[1] Pohang Univ Sci & Technol POSTECH, Pohang, South Korea
关键词
D O I
10.1109/CVPR52688.2022.01770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.
引用
收藏
页码:18218 / 18227
页数:10
相关论文
共 50 条
  • [1] Parallel Style-Aware Image Cloning for Artworks
    Zhao, Yandan
    Jin, Xiaogang
    Xu, Yingqing
    Zhao, Hanli
    Ai, Meng
    Zhou, Kun
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (02) : 229 - 240
  • [2] Disentangling Structure and Aesthetics for Style-aware Image Completion
    Gilbert, Andrew
    Collomosse, John
    Jin, Hailin
    Price, Brian
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1848 - 1856
  • [3] Style-Aware Contrastive Learning for Multi-Style Image Captioning
    Zhou, Yucheng
    Long, Guodong
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 2257 - 2267
  • [4] Fashion Style-Aware Embeddings for Clothing Image Retrieval
    Naka, Rino
    Katsurai, Marie
    Yanagi, Keisuke
    Goto, Ryosuke
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 49 - 53
  • [5] Style-Aware Image Recommendation for Social Media Marketing
    Zhang, Yiwei
    Yamasaki, Toshihiko
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3106 - 3114
  • [6] Style-aware adversarial pairwise ranking for image recommendation systems
    Zhefu Wu
    Song Zhang
    Agyemang Paul
    Luping Fang
    International Journal of Multimedia Information Retrieval, 2023, 12
  • [7] Style-aware adversarial pairwise ranking for image recommendation systems
    Wu, Zhefu
    Zhang, Song
    Paul, Agyemang
    Fang, Luping
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2023, 12 (02)
  • [8] Room Style Estimation for Style-Aware Recommendation
    Ataer-Cansizoglu, Esra
    Liu, Hantian
    Weiss, Tomer
    Mitra, Archi
    Dholakia, Dhaval
    Choi, Jae-Woo
    Wayfair, Dan Wulin
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2019, : 267 - 270
  • [9] Style-aware and multi-scale attention for face image completion
    Liu H.
    Li S.
    Zhu X.
    Sun H.
    Zhang J.
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2022, 54 (05): : 49 - 56
  • [10] StarEnhancer: Learning Real-Time and Style-Aware Image Enhancement
    Song, Yuda
    Qian, Hui
    Du, Xin
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4106 - 4115