Style-Guided Image-to-Image Translation for Multiple Domains

被引:4
|
作者
Li, Tingting [1 ]
Zhao, Huan [1 ]
Wang, Song [1 ]
Huang, Jing [1 ]
机构
[1] Hunan Univ, Changsha, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
Diversity; style features; generative adversarial network (GAN); image-to-image translation; multiple domains; quality; GENERATIVE ADVERSARIAL NETWORKS;
D O I
10.1145/3463945.3469057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The cross-domain image translation has drawn more and more attention. It aims to translate images from a source domain into target domains, such that images can appear in multiple styles. The most popular approaches are using encoders to extract style features from the source domain and then pushing them into a generator to produce new images. However, these methods usually only suit for two domains translation, and present low diversity in multiple domains since the extracted features are roughly used as input for the generator, instead of making full use of them. In this paper, we design a novel loss function, style-guided diversity loss (Sd loss), which utilizes the extracted style features to encourage our model exploring the image space and discovering diverse images. It is proved theoretically that the proposed loss is better than the diversity sensitive loss in the state-of-the-art approaches. In addition, qualitative and quantitative experiments demonstrate the superiority of the proposed approach against several state-of-the-art approaches in terms of the quality and the diversity of translated images.
引用
收藏
页码:28 / 36
页数:9
相关论文
共 50 条
  • [1] Style-Guided and Disentangled Representation for Robust Image-to-Image Translation
    Choi, Jaewoong
    Kim, Daeha
    Song, Byung Cheol
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 463 - 471
  • [2] Enhancing Style-Guided Image-to-Image Translation via Self-Supervised Metric Learning
    Mao, Qi
    Ma, Siwei
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8511 - 8526
  • [3] Unsupervised Image-to-Image Translation with Style Consistency
    Lai, Binxin
    Wang, Yuan-Gen
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VI, 2024, 14430 : 322 - 334
  • [4] Leveraging Local Domains for Image-to-Image Translation
    Dell'Eva, Anthony
    Pizzati, Fabio
    Bertozzi, Massimo
    de Charette, Raoul
    [J]. PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, : 179 - 189
  • [5] Guided Image Weathering using Image-to-Image Translation
    Chen, Yu
    Shen, I-Chao
    Chen, Bing-Yu
    [J]. PROCEEDINGS OF SIGGRAPH ASIA 2021 TECHNICAL COMMUNICATIONS, 2021,
  • [6] Semantic Example Guided Image-to-Image Translation
    Huang, Jialu
    Liao, Jing
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1654 - 1665
  • [7] Unsupervised many-to-many image-to-image translation across multiple domains
    Lin, Ye
    Fu, Keren
    Ling, Shenggui
    Cheng, Peng
    [J]. IET IMAGE PROCESSING, 2021, 15 (11) : 2412 - 2423
  • [8] Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation
    Richardson, Elad
    Alaluf, Yuval
    Patashnik, Or
    Nitzan, Yotam
    Azar, Yaniv
    Shapiro, Stav
    Cohen-Or, Daniel
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2287 - 2296
  • [9] SHUNIT: Style Harmonization for Unpaired Image-to-Image Translation
    Song, Seokbeom
    Lee, Suhyeon
    Seong, Hongje
    Min, Kyoungwon
    Kim, Euntai
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 2292 - 2302
  • [10] Image-to-image Translation via Hierarchical Style Disentanglement
    Li, Xinyang
    Zhang, Shengchuan
    Hu, Jie
    Cao, Liujuan
    Hong, Xiaopeng
    Mao, Xudong
    Huang, Feiyue
    Wu, Yongjian
    Ji, Rongrong
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8635 - 8644