Multi-style cartoonization: Leveraging multiple datasets with generative adversarial networks

被引:0
|
作者
Cai, Jianlu [1 ]
Li, Frederick W. B. [2 ]
Nan, Fangzhe [1 ]
Yang, Bailin [1 ,3 ]
机构
[1] Zhejiang Gongshang Univ, Dept Comp Sci & Technol, Hangzhou, Peoples R China
[2] Univ Durham, Dept Comp Sci, Durham, England
[3] Zhejiang Gongshang Univ, Dept Comp Sci, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
generative adversarial network; multi-style transfer; photo cartoonization;
D O I
10.1002/cav.2269
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scene cartoonization aims to convert photos into stylized cartoons. While generative adversarial networks (GANs) can generate high-quality images, previous methods focus on individual images or single styles, ignoring relationships between datasets. We propose a novel multi-style scene cartoonization GAN that leverages multiple cartoon datasets jointly. Our main technical contribution is a multi-branch style encoder that disentangles representations to model styles as distributions over entire datasets rather than images. Combined with a multi-task discriminator and perceptual losses optimizing across collections, our model achieves state-of-the-art diverse stylization while preserving semantics. Experiments demonstrate that by learning from inter-dataset relationships, our method translates photos into cartoon images with improved realism and abstraction fidelity compared to prior arts, without iterative re-training for new styles. We introduce a multi-style scene cartoonization GAN aiming to enhance the technique of photo-to-cartoon conversion. By amalgamating multiple cartoon datasets and employing innovative encoding methods, our model achieves more realistic and abstract cartoon effects, surpassing previous approaches. By capturing relationships between datasets, we can provide high-quality cartoon images without the need for tedious iterative retraining, marking a subtle but significant advancement in the field. image
引用
收藏
页数:15
相关论文
共 50 条
  • [31] PDEGAN: A Panoramic Style Transfer Based on Generative Adversarial Networks
    Wang, Qinghua
    Long, Xinling
    Huang, Jingwei
    Chen, Yang
    Yang, Lirong
    Zhang, Fuquan
    Journal of Network Intelligence, 2024, 9 (04): : 2112 - 2121
  • [32] Styleformer: Transformer based Generative Adversarial Networks with Style Vector
    Park, Jeeseung
    Kim, Younggeun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8973 - 8982
  • [33] MSGAN: Generative Adversarial Networks for Image Seasonal Style Transfer
    Zhang, Fuquan
    Wang, Chuansheng
    IEEE ACCESS, 2020, 8 : 104830 - 104840
  • [34] A Style-Based Generator Architecture for Generative Adversarial Networks
    Karras, Tero
    Laine, Samuli
    Aila, Timo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4217 - 4228
  • [35] Generative Image Modeling Using Style and Structure Adversarial Networks
    Wang, Xiaolong
    Gupta, Abhinav
    COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 : 318 - 335
  • [36] Multi-view Generative Adversarial Networks
    Chen, Mickael
    Denoyer, Ludovic
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT II, 2017, 10535 : 175 - 188
  • [37] IMGG: Integrating Multiple Single-Cell Datasets through Connected Graphs and Generative Adversarial Networks
    Wang, Xun
    Zhang, Chaogang
    Zhang, Ying
    Meng, Xiangyu
    Zhang, Zhiyuan
    Shi, Xin
    Song, Tao
    INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES, 2022, 23 (04)
  • [38] Tea Chrysanthemum Detection by Leveraging Generative Adversarial Networks and Edge Computing
    Qi, Chao
    Gao, Junfeng
    Chen, Kunjie
    Shu, Lei
    Pearson, Simon
    FRONTIERS IN PLANT SCIENCE, 2022, 13
  • [39] Conditional Wasserstein Generative Adversarial Networks for Rebalancing Iris Image Datasets
    Li, Yung-Hui
    Aslam, Muhammad Saqlain
    Harfiya, Latifa Nabila
    Chang, Ching-Chun
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (09) : 1450 - 1458
  • [40] A Survey on Recent Advancements in Lightweight Generative Adversarial Networks, their Applications and Datasets
    Alexiou, Michail S.
    Mertoguno, J. Sukarno
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 269 - 278