MISS GAN: A Multi-IlluStrator style generative adversarial network for image to illustration translation

被引:9
|
作者
Barzilay, Noa [1 ]
Shalev, Tal Berkovitz [1 ]
Giryes, Raja [1 ]
机构
[1] Tel Aviv Univ, Sch Elect Engn, IL-69978 Tel Aviv, Israel
关键词
Generative adversarial networks; Image to image translation; Illustration; Multi style transfer; TEXT;
D O I
10.1016/j.patrec.2021.08.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised style transfer that supports diverse input styles using only one trained generator is a challenging and interesting task in computer vision. This paper proposes a Multi-IlluStrator Style Generative Adversarial Network (MISS GAN) that is a multi-style framework for unsupervised image-to-illustration translation, which can generate styled yet content preserving images. The illustrations dataset is a challenging one since it is comprised of illustrations of seven different illustrators, hence contains diverse styles. Existing methods require to train several generators (as the number of illustrators) to handle the different illustrators' styles, which limits their practical usage, or require to train an image specific network, which ignores the style information provided in other images of the illustrator. MISS GAN is both input image specific and uses the information of other images using only one trained model. (c) 2021 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:140 / 147
页数:8
相关论文
共 50 条
  • [31] Multi-Attention Generative Adversarial Network for image captioning
    Wei, Yiwei
    Wang, Leiquan
    Cao, Haiwen
    Shao, Mingwen
    Wu, Chunlei
    NEUROCOMPUTING, 2020, 387 : 91 - 99
  • [32] Generative Adversarial Network with Multi-branch Discriminator for imbalanced cross-species image-to-image translation
    Zheng, Ziqiang
    Yu, Zhibin
    Wu, Yang
    Zheng, Haiyong
    Zheng, Bing
    Lee, Minho
    NEURAL NETWORKS, 2021, 141 : 355 - 371
  • [33] SoloGAN: Multi-domain Multimodal Unpaired Image-to-Image Translation via a Single Generative Adversarial Network
    Huang S.
    He C.
    Cheng R.
    IEEE Transactions on Artificial Intelligence, 2022, 3 (05): : 722 - 737
  • [34] A model integrating attention mechanism and generative adversarial network for image style transfer
    Fu, Miaomiao
    Liu, Yixing
    Ma, Rongrong
    Zhang, Binbin
    Wu, Linli
    Zhu, Lingli
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [35] IMAGE COLORED-PENCIL-STYLE TRANSFORMATION BASED ON GENERATIVE ADVERSARIAL NETWORK
    Chen, Haitao
    Tak, Kin U.
    PROCEEDINGS OF 2020 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2020, : 90 - 95
  • [36] Multi-Style Unsupervised Image Synthesis Using Generative Adversarial Nets
    Lv, Guoyun
    Israr, Syed Muhammad
    Qi, Shengyong
    IEEE ACCESS, 2021, 9 : 86025 - 86036
  • [37] FG-GAN: A Fine-Grained Generative Adversarial Network for Unsupervised SAR-to-Optical Image Translation
    Yang, Xi
    Wang, Zihan
    Zhao, Jingyi
    Yang, Dong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [38] UCT-GAN: underwater image colour transfer generative adversarial network
    Deng, Junjie
    Luo, Gege
    Zhao, Caidan
    IET IMAGE PROCESSING, 2020, 14 (14) : 3613 - 3622
  • [39] MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement
    Zhang, Tianchi
    Liu, Yuxuan
    Mase, Atsushi
    APPLIED SCIENCES-BASEL, 2024, 14 (02):
  • [40] MSF-GAN: Multi-Scale Fuzzy Generative Adversarial Network for Breast Ultrasound Image Segmentation
    Huang, Kuan
    Zhang, Yingtao
    Cheng, H. D.
    Xing, Ping
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 3193 - 3196