MF-Net: A Novel Few-shot Stylized Multilingual Font Generation Method

被引:5
|
作者
Zhang, Yufan [1 ]
Man, Junkai [1 ]
Sun, Peng [1 ]
机构
[1] Duke Kunshan Univ, Kunshan, Peoples R China
关键词
Style transfer; image synthesis; font design; few-shot learning;
D O I
10.1145/3503161.3548414
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Creating a complete stylized font library that helps the audience to perceive information from the text often requires years of study and proficiency in the use of many professional tools. Accordingly, automatic stylized font generation in a deep learning-based fashion is a desirable but challenging task that has attracted a lot of attention in recent years. This paper revisits the state-of-the-art methods for stylized font generation and presents a taxonomy of the deep learning-based stylized font generation. Despite the notable performance of the existing models, stylized multilingual font generation, the task of applying specific font style to diverse characters in multiple languages has never been reported to be addressed. An efficient and economical method for stylized multilingual font generation is essential in numerous application scenarios that require communication with international audiences. We propose a solution for few-shot multilingual stylized font generation by a fast feed-forward network, Multilingual Font Generation Network (MF-Net), which can transfer previously unseen font styles from a few samples to characters from previously unseen languages. Following the Generative Adversarial Network (GAN) framework, MF-Net adopts two separate encoders in the generator to decouple a font image's content and style information. We adopt an attention module in the style encoder to extract both shallow and deep style features. Moreover, we also design a novel language complexityaware skip connection to adaptive adjust the structural information to be preserved. With an effective loss function to improve the visual quality of the generated font images, we show the effectiveness of the proposed MF-Net based on quantitative and subjective visual evaluation, and compare it with the existing models in the scenario of stylized multilingual font generation. The source code is available on https://github.com/iamyufan/MF-Net.
引用
收藏
页码:2088 / 2096
页数:9
相关论文
共 50 条
  • [41] A novel method of data and feature enhancement for few-shot image classification
    Wu, Yirui
    Wu, Benze
    Zhang, Yunfei
    Wan, Shaohua
    SOFT COMPUTING, 2023, 27 (08) : 5109 - 5117
  • [42] HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution
    Li, Hua
    Lian, Zhouhui
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (06):
  • [43] A novel method of data and feature enhancement for few-shot image classification
    Yirui Wu
    Benze Wu
    Yunfei Zhang
    Shaohua Wan
    Soft Computing, 2023, 27 : 5109 - 5117
  • [44] An Image Enhancement Method for Few-shot Classification
    Wu, Benze
    Wu, Yirui
    Wan, Shaohua
    2021 IEEE 19TH INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (EUC 2021), 2021, : 159 - 165
  • [45] A Variational Inference Method for Few-Shot Learning
    Xu, Jian
    Liu, Bo
    Xiao, Yanshan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 269 - 282
  • [46] A Image Enhancement Method for Few-shot Classification
    Wu, Benze
    Wu, Yirui
    Wan, Shaohua
    2021 IEEE 19TH INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (EUC 2021), 2021, : 201 - 207
  • [47] Few-shot image generation with reverse contrastive learning
    Gou, Yao
    Li, Min
    Zhang, Yusen
    He, Zhuzhen
    He, Yujie
    NEURAL NETWORKS, 2024, 169 : 154 - 164
  • [48] Few-Shot Text Generation with Natural Language Instructions
    Schick, Timo
    Schuetze, Hinrich
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 390 - 402
  • [49] Pseudo Siamese Network for Few-shot Intent Generation
    Xia, Congying
    Xiong, Caiming
    Yu, Philip
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 2005 - 2009
  • [50] Curvature Generation in Curved Spaces for Few-Shot Learning
    Gao, Zhi
    Wu, Yuwei
    Jia, Yunde
    Harandi, Mehrtash
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8671 - 8680