MISS GAN: A Multi-IlluStrator style generative adversarial network for image to illustration translation

被引:9
|
作者
Barzilay, Noa [1 ]
Shalev, Tal Berkovitz [1 ]
Giryes, Raja [1 ]
机构
[1] Tel Aviv Univ, Sch Elect Engn, IL-69978 Tel Aviv, Israel
关键词
Generative adversarial networks; Image to image translation; Illustration; Multi style transfer; TEXT;
D O I
10.1016/j.patrec.2021.08.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised style transfer that supports diverse input styles using only one trained generator is a challenging and interesting task in computer vision. This paper proposes a Multi-IlluStrator Style Generative Adversarial Network (MISS GAN) that is a multi-style framework for unsupervised image-to-illustration translation, which can generate styled yet content preserving images. The illustrations dataset is a challenging one since it is comprised of illustrations of seven different illustrators, hence contains diverse styles. Existing methods require to train several generators (as the number of illustrators) to handle the different illustrators' styles, which limits their practical usage, or require to train an image specific network, which ignores the style information provided in other images of the illustrator. MISS GAN is both input image specific and uses the information of other images using only one trained model. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 147
页数:8
相关论文
共 50 条
  • [1] GANILLA: Generative adversarial networks for image to illustration translation
    Hicsonmez, Samet
    Samet, Nermin
    Akbas, Emre
    Duygulu, Pinar
    [J]. IMAGE AND VISION COMPUTING, 2020, 95
  • [2] Image Style Transfer based on Generative Adversarial Network
    Hu, Chan
    Ding, Youdong
    Li, Yuhang
    [J]. PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 2098 - 2102
  • [3] Underwater Image Translation via Multi-Scale Generative Adversarial Network
    Yang, Dongmei
    Zhang, Tianzi
    Li, Boquan
    Li, Menghao
    Chen, Weijing
    Li, Xiaoqing
    Wang, Xingmei
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (10)
  • [4] LC-GAN: Image-to-image Translation Based on Generative Adversarial Network for Endoscopic Images
    Lin, Shan
    Qin, Fangbo
    Li, Yangming
    Bly, Randall A.
    Moe, Kris S.
    Hannaford, Blake
    [J]. 2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 2914 - 2920
  • [5] GRA-GAN: Generative adversarial network for image style transfer of Gender, Race, and age
    Kim, Yu Hwan
    Nam, Se Hyun
    Hong, Seung Baek
    Park, Kang Ryoung
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 198
  • [6] A Generative Adversarial Network AMS-CycleGAN for Multi-Style Image Transformation
    Rang, Xiaodi
    Dong, Zhengyu
    Han, Jiachen
    Ma, Chaoqing
    Zhao, Guangzhi
    Zhang, Wenchao
    [J]. IEEE ACCESS, 2024, 12 : 65141 - 65153
  • [7] Generative Adversarial Network for Multi Facial Attributes Translation
    Liu, Jun
    Liu, Xiaoyang
    Feng, Yanjun
    [J]. IEEE ACCESS, 2021, 9 (09): : 129375 - 129384
  • [8] A Domain Gap Aware Generative Adversarial Network for Multi-Domain Image Translation
    Xu, Wenju
    Wang, Guanghui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 72 - 84
  • [9] WeaGAN:Generative Adversarial Network for Weather Translation of Image among Multi-domain
    Lin, Yating
    Li, Yidong
    Cui, Haidong
    Feng, Zheng
    [J]. 2019 6TH INTERNATIONAL CONFERENCE ON BEHAVIORAL, ECONOMIC AND SOCIO-CULTURAL COMPUTING (BESC 2019), 2019,
  • [10] Image Steganography and Style Transformation Based on Generative Adversarial Network
    Li, Li
    Zhang, Xinpeng
    Chen, Kejiang
    Feng, Guorui
    Wu, Deyang
    Zhang, Weiming
    [J]. MATHEMATICS, 2024, 12 (04)