Multi-style cartoonization: Leveraging multiple datasets with generative adversarial networks

被引:0
|
作者
Cai, Jianlu [1 ]
Li, Frederick W. B. [2 ]
Nan, Fangzhe [1 ]
Yang, Bailin [1 ,3 ]
机构
[1] Zhejiang Gongshang Univ, Dept Comp Sci & Technol, Hangzhou, Peoples R China
[2] Univ Durham, Dept Comp Sci, Durham, England
[3] Zhejiang Gongshang Univ, Dept Comp Sci, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
generative adversarial network; multi-style transfer; photo cartoonization;
D O I
10.1002/cav.2269
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scene cartoonization aims to convert photos into stylized cartoons. While generative adversarial networks (GANs) can generate high-quality images, previous methods focus on individual images or single styles, ignoring relationships between datasets. We propose a novel multi-style scene cartoonization GAN that leverages multiple cartoon datasets jointly. Our main technical contribution is a multi-branch style encoder that disentangles representations to model styles as distributions over entire datasets rather than images. Combined with a multi-task discriminator and perceptual losses optimizing across collections, our model achieves state-of-the-art diverse stylization while preserving semantics. Experiments demonstrate that by learning from inter-dataset relationships, our method translates photos into cartoon images with improved realism and abstraction fidelity compared to prior arts, without iterative re-training for new styles. We introduce a multi-style scene cartoonization GAN aiming to enhance the technique of photo-to-cartoon conversion. By amalgamating multiple cartoon datasets and employing innovative encoding methods, our model achieves more realistic and abstract cartoon effects, surpassing previous approaches. By capturing relationships between datasets, we can provide high-quality cartoon images without the need for tedious iterative retraining, marking a subtle but significant advancement in the field. image
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Style Transfer Using Generative Adversarial Networks for Multi-site MRI Harmonization
    Liu, Mengting
    Maiti, Piyush
    Thomopoulos, Sophia
    Zhu, Alyssa
    Chai, Yaqiong
    Kim, Hosung
    Jahanshad, Neda
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 313 - 322
  • [22] Cartoon-Flow: A Flow-Based Generative Adversarial Network for Arbitrary-Style Photo Cartoonization
    Lee, Jieun
    Kim, Hyeonwoo
    Shim, Jonghwa
    Hwang, Eenjun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1241 - 1251
  • [23] Efficient Generative Adversarial Networks for Imbalanced Traffic Collision Datasets
    Chen, Mu-Yen
    Chiang, Hsiu-Sen
    Huang, Wei-Kai
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19864 - 19873
  • [24] NVCGAN: Leveraging Generative Adversarial Networks for Robust Voice Conversion
    Zhang, Guoyu
    Liu, Jingrui
    Bi, Wenhao
    Dongye, Guangcheng
    Zhang, Li
    Jing, Ming
    Yu, Jiguo
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 330 - 342
  • [25] Augmenting The Size of EEG datasets Using Generative Adversarial Networks
    Abdelfattah, Sherif M.
    Abdelrahman, Ghodai M.
    Wang, Min
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [26] Augmenting Historical Alphabet Datasets Using Generative Adversarial Networks
    Franc, David
    Hamplova, Adela
    Svojse, Ondrej
    DATA SCIENCE AND ALGORITHMS IN SYSTEMS, 2022, VOL 2, 2023, 597 : 132 - 141
  • [27] Balancing Imbalanced Datasets Using Generative Adversarial Neural Networks
    Divovic, Pavle
    Obradovic, Predrag
    Misic, Marko
    2021 29TH TELECOMMUNICATIONS FORUM (TELFOR), 2021,
  • [28] Leveraging generative adversarial networks for enhanced cryptographic key generation
    Singh, Purushottam
    Pranav, Prashant
    Anwar, Shamama
    Dutta, Sandip
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024,
  • [29] Predictions on multi-class terminal ballistics datasets using conditional Generative Adversarial Networks
    Thompson, S.
    Teixeira-Dias, F.
    Paulino, M.
    Hamilton, A.
    NEURAL NETWORKS, 2022, 154 : 425 - 440
  • [30] A Style-Based Generator Architecture for Generative Adversarial Networks
    Karras, Tero
    Laine, Samuli
    Aila, Timo
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4396 - 4405