Multi-style cartoonization: Leveraging multiple datasets with generative adversarial networks

被引:0
|
作者
Cai, Jianlu [1 ]
Li, Frederick W. B. [2 ]
Nan, Fangzhe [1 ]
Yang, Bailin [1 ,3 ]
机构
[1] Zhejiang Gongshang Univ, Dept Comp Sci & Technol, Hangzhou, Peoples R China
[2] Univ Durham, Dept Comp Sci, Durham, England
[3] Zhejiang Gongshang Univ, Dept Comp Sci, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
generative adversarial network; multi-style transfer; photo cartoonization;
D O I
10.1002/cav.2269
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scene cartoonization aims to convert photos into stylized cartoons. While generative adversarial networks (GANs) can generate high-quality images, previous methods focus on individual images or single styles, ignoring relationships between datasets. We propose a novel multi-style scene cartoonization GAN that leverages multiple cartoon datasets jointly. Our main technical contribution is a multi-branch style encoder that disentangles representations to model styles as distributions over entire datasets rather than images. Combined with a multi-task discriminator and perceptual losses optimizing across collections, our model achieves state-of-the-art diverse stylization while preserving semantics. Experiments demonstrate that by learning from inter-dataset relationships, our method translates photos into cartoon images with improved realism and abstraction fidelity compared to prior arts, without iterative re-training for new styles. We introduce a multi-style scene cartoonization GAN aiming to enhance the technique of photo-to-cartoon conversion. By amalgamating multiple cartoon datasets and employing innovative encoding methods, our model achieves more realistic and abstract cartoon effects, surpassing previous approaches. By capturing relationships between datasets, we can provide high-quality cartoon images without the need for tedious iterative retraining, marking a subtle but significant advancement in the field. image
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [1] GAN-Based Multi-Style Photo Cartoonization
    Shu, Yezhi
    Yi, Ran
    Xia, Mengfei
    Ye, Zipeng
    Zhao, Wang
    Chen, Yang
    Lai, Yu-Kun
    Liu, Yong-Jin
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (10) : 3376 - 3390
  • [2] MCLGAN: a multi-style cartoonization method based on style condition information
    Li, Canlin
    Wang, Xinyue
    Yi, Ran
    Zhang, Wenjiao
    Bi, Lihua
    Ma, Lizhuang
    VISUAL COMPUTER, 2024, : 2529 - 2544
  • [3] CartoonGAN: Generative Adversarial Networks for Photo Cartoonization
    Chen, Yang
    Lai, Yu-Kun
    Liu, Yong-Jin
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 9465 - 9474
  • [4] Multi-Style Unsupervised Image Synthesis Using Generative Adversarial Nets
    Lv, Guoyun
    Israr, Syed Muhammad
    Qi, Shengyong
    IEEE ACCESS, 2021, 9 : 86025 - 86036
  • [5] A Generative Adversarial Network AMS-CycleGAN for Multi-Style Image Transformation
    Rang, Xiaodi
    Dong, Zhengyu
    Han, Jiachen
    Ma, Chaoqing
    Zhao, Guangzhi
    Zhang, Wenchao
    IEEE ACCESS, 2024, 12 : 65141 - 65153
  • [6] Multi-Style Generative Reading Comprehension
    Nishida, Kyosuke
    Saito, Itsumi
    Nishida, Kosuke
    Shinoda, Kazutoshi
    Otsuka, Atsushi
    Asano, Hisako
    Tomita, Junji
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 2273 - 2284
  • [7] Attention mechanism-based generative adversarial networks for image cartoonization
    Zhao, Wenqing
    Zhu, Jianlin
    Li, Ping
    Huang, Jin
    Tang, Junwei
    VISUAL COMPUTER, 2024, 40 (06): : 3971 - 3984
  • [8] RadialGAN: Leveraging multiple datasets to improve target-specific predictive models using Generative Adversarial Networks
    Yoon, Jinsung
    Jordon, James
    van der Schaar, Mihaela
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [9] Leveraging Generative Models for Combating Adversarial Attacks on Tabular Datasets
    Zhou, Jiahui
    Zaidi, Nayyar
    Zhang, Yishuo
    Montague, Paul
    Kim, Junae
    Li, Gang
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT I, 2023, 13935 : 147 - 158
  • [10] Leveraging Contaminated Datasets to Learn Clean-Data Distribution with Purified Generative Adversarial Networks
    Tian, Bowen
    Su, Qinliang
    Yu, Jianxing
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9989 - 9996