MF-Net: A Novel Few-shot Stylized Multilingual Font Generation Method

被引:5
|
作者
Zhang, Yufan [1 ]
Man, Junkai [1 ]
Sun, Peng [1 ]
机构
[1] Duke Kunshan Univ, Kunshan, Peoples R China
关键词
Style transfer; image synthesis; font design; few-shot learning;
D O I
10.1145/3503161.3548414
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Creating a complete stylized font library that helps the audience to perceive information from the text often requires years of study and proficiency in the use of many professional tools. Accordingly, automatic stylized font generation in a deep learning-based fashion is a desirable but challenging task that has attracted a lot of attention in recent years. This paper revisits the state-of-the-art methods for stylized font generation and presents a taxonomy of the deep learning-based stylized font generation. Despite the notable performance of the existing models, stylized multilingual font generation, the task of applying specific font style to diverse characters in multiple languages has never been reported to be addressed. An efficient and economical method for stylized multilingual font generation is essential in numerous application scenarios that require communication with international audiences. We propose a solution for few-shot multilingual stylized font generation by a fast feed-forward network, Multilingual Font Generation Network (MF-Net), which can transfer previously unseen font styles from a few samples to characters from previously unseen languages. Following the Generative Adversarial Network (GAN) framework, MF-Net adopts two separate encoders in the generator to decouple a font image's content and style information. We adopt an attention module in the style encoder to extract both shallow and deep style features. Moreover, we also design a novel language complexityaware skip connection to adaptive adjust the structural information to be preserved. With an effective loss function to improve the visual quality of the generated font images, we show the effectiveness of the proposed MF-Net based on quantitative and subjective visual evaluation, and compare it with the existing models in the scenario of stylized multilingual font generation. The source code is available on https://github.com/iamyufan/MF-Net.
引用
收藏
页码:2088 / 2096
页数:9
相关论文
共 50 条
  • [31] Meta-BN Net for few-shot learning
    Wei Gao
    Mingwen Shao
    Jun Shu
    Xinkai Zhuang
    Frontiers of Computer Science, 2023, 17
  • [32] Meta-BN Net for few-shot learning
    Gao, Wei
    Shao, Mingwen
    Shu, Jun
    Zhuang, Xinkai
    FRONTIERS OF COMPUTER SCIENCE, 2023, 17 (01)
  • [33] ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach
    Wen, Qi
    Li, Shuang
    Han, Bingfeng
    Yuan, Yi
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 621 - 629
  • [34] A Closer Look at Few-shot Image Generation
    Zhao, Yunqing
    Ding, Henghui
    Huang, Houjing
    Cheung, Ngai-Man
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9130 - 9140
  • [35] DataDream: Few-Shot Guided Dataset Generation
    Kim, Jae Myung
    Bader, Jessica
    Alaniz, Stephan
    Schmid, Cordelia
    Akata, Zeynep
    COMPUTER VISION - ECCV 2024, PT LXXI, 2025, 15129 : 252 - 268
  • [36] FEW-SHOT GENERATION BY MODELING STEREOSCOPIC PRIORS
    Wang, Yuehui
    Wang, Qing
    Zhang, Dongyu
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2370 - 2374
  • [37] Counterfactual Generation Framework for Few-Shot Learning
    Dang, Zhuohang
    Luo, Minnan
    Jia, Chengyou
    Yan, Caixia
    Chang, Xiaojun
    Zheng, Qinghua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 3747 - 3758
  • [38] Few-shot Fish Image Generation and Classification
    Guo, Zonghui
    Zhang, Liqiang
    Jiang, Yufeng
    Niu, Wenjie
    Gu, Zhaorui
    Zheng, Haiyong
    Wang, Guoyu
    Zheng, Bing
    GLOBAL OCEANS 2020: SINGAPORE - U.S. GULF COAST, 2020,
  • [39] SW-Net: A novel few-shot learning approach for disease subtype prediction
    Ji, Yuhan
    Liang, Yong
    Yang, Ziyi
    AI, Ning
    BIOCELL, 2023, 47 (03) : 569 - 579
  • [40] A Novel Group-Aware Pruning Method for Few-shot Learning
    Zheng, Yin-Dong
    Ma, Yun-Tao
    Liu, Ruo-Ze
    Lu, Tong
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,