A Style-aware Discriminator for Controllable Image Translation

被引:17
|
作者
Kim, Kunhee [1 ]
Park, Sanghun [1 ]
Jeon, Eunyeong [1 ]
Kim, Taehun [1 ]
Kim, Daijin [1 ]
机构
[1] Pohang Univ Sci & Technol POSTECH, Pohang, South Korea
关键词
D O I
10.1109/CVPR52688.2022.01770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.
引用
收藏
页码:18218 / 18227
页数:10
相关论文
共 50 条
  • [21] Hierarchical Style-Aware Domain Generalization for Remote Physiological Measurement
    Wang, Jiyao
    Lu, Hao
    Wang, Ange
    Chen, Yingcong
    He, Dengbo
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (03) : 1635 - 1643
  • [22] Learning to Style-Aware Bayesian Personalized Ranking for Visual Recommendation
    He, Ming
    Zhang, Shaozong
    Meng, Qian
    IEEE ACCESS, 2019, 7 : 14198 - 14205
  • [23] Exploring Style-Robust Scene Text Detection via Style-Aware Learning
    Cai, Yuanqiang
    Zhou, Fenfen
    Yin, Ronghui
    ELECTRONICS, 2024, 13 (02)
  • [24] Learning Style-Aware Symbolic Music Representations by Adversarial Autoencoders
    Valenti, Andrea
    Carta, Antonio
    Bacciu, Davide
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1563 - 1570
  • [25] A style-aware architectural middleware for resource-constrained, distributed systems
    Malek, S
    Mikic-Rakic, M
    Medvidovic, N
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2005, 31 (03) : 256 - 272
  • [26] Style-aware two-stage learning framework for video captioning
    Ma, Yunchuan
    Zhu, Zheng
    Qi, Yuankai
    Beheshti, Amin
    Li, Ying
    Qing, Laiyun
    Li, Guorong
    KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [27] PAINTING STYLE-AWARE MANGA COLORIZATION BASED ON GENERATIVE ADVERSARIAL NETWORKS
    Shimizu, Yugo
    Furuta, Ryosuke
    Ouyang, Delong
    Taniguchi, Yukinobu
    Hinami, Ryota
    Ishiwatari, Shonosuke
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1739 - 1743
  • [28] Painting style-aware manga colorization based on generative adversarial networks
    Tokyo University of Science, Japan
    不详
    不详
    arXiv, 1600,
  • [29] Style-Aware Radiology Report Generation with RadGraph and Few-Shot Prompting
    Yan, Benjamin
    Liu, Ruochen
    Kuo, David E.
    Adithan, Subathra
    Reis, Eduardo Pontes
    Kwak, Stephen
    Venugopal, Vasantha Kumar
    O'Connell, Chloe P.
    Saenz, Agustina
    Rajpurkar, Pranav
    Moor, Michael
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 14676 - 14688
  • [30] Unsupervised learning of style-aware facial animation from real acting performances
    Paier, Wolfgang
    Hilsmann, Anna
    Eisert, Peter
    GRAPHICAL MODELS, 2023, 129