MF-Net: A Novel Few-shot Stylized Multilingual Font Generation Method

被引:5
|
作者
Zhang, Yufan [1 ]
Man, Junkai [1 ]
Sun, Peng [1 ]
机构
[1] Duke Kunshan Univ, Kunshan, Peoples R China
关键词
Style transfer; image synthesis; font design; few-shot learning;
D O I
10.1145/3503161.3548414
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Creating a complete stylized font library that helps the audience to perceive information from the text often requires years of study and proficiency in the use of many professional tools. Accordingly, automatic stylized font generation in a deep learning-based fashion is a desirable but challenging task that has attracted a lot of attention in recent years. This paper revisits the state-of-the-art methods for stylized font generation and presents a taxonomy of the deep learning-based stylized font generation. Despite the notable performance of the existing models, stylized multilingual font generation, the task of applying specific font style to diverse characters in multiple languages has never been reported to be addressed. An efficient and economical method for stylized multilingual font generation is essential in numerous application scenarios that require communication with international audiences. We propose a solution for few-shot multilingual stylized font generation by a fast feed-forward network, Multilingual Font Generation Network (MF-Net), which can transfer previously unseen font styles from a few samples to characters from previously unseen languages. Following the Generative Adversarial Network (GAN) framework, MF-Net adopts two separate encoders in the generator to decouple a font image's content and style information. We adopt an attention module in the style encoder to extract both shallow and deep style features. Moreover, we also design a novel language complexityaware skip connection to adaptive adjust the structural information to be preserved. With an effective loss function to improve the visual quality of the generated font images, we show the effectiveness of the proposed MF-Net based on quantitative and subjective visual evaluation, and compare it with the existing models in the scenario of stylized multilingual font generation. The source code is available on https://github.com/iamyufan/MF-Net.
引用
收藏
页码:2088 / 2096
页数:9
相关论文
共 50 条
  • [1] Font transformer for few-shot font generation
    Chen, Xu
    Wu, Lei
    Su, Yongliang
    Meng, Lei
    Meng, Xiangxu
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 245
  • [2] MA-Font: Few-Shot Font Generation by Multi-Adaptation Method
    Qiu, Yanbo
    Chu, Kaibin
    Zhang, Ji
    Feng, Chengtao
    IEEE ACCESS, 2024, 12 : 60765 - 60781
  • [3] CF-Font: Content Fusion for Few-shot Font Generation
    Wang, Chi
    Zhou, Min
    Ge, Tiezheng
    Jiang, Yuning
    Bao, Hujun
    Xu, Weiwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1858 - 1867
  • [4] FA-Font: Feature Aggregation for Few-shot Font Generation
    Lv, Guojin
    Zhao, Hongyu
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ALGORITHMS, SOFTWARE ENGINEERING, AND NETWORK SECURITY, ASENS 2024, 2024, : 254 - 261
  • [5] Few-Shot Content-Level Font Generation
    Majeed, Saima
    Ul Hassan, Ammar
    Choi, Jaeyoung
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (04): : 1166 - 1186
  • [6] Few-Shot Font Generation with Deep Metric Learning
    Aoki, Haruka
    Tsubota, Koki
    Ikuta, Hikaru
    Aizawa, Kiyoharu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8539 - 8546
  • [7] Few-Shot Font Generation With Weakly Supervised Localized Representations
    Park, Song
    Chun, Sanghyuk
    Cha, Junbum
    Lee, Bado
    Shim, Hyunjung
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1479 - 1495
  • [8] Few-Shot Font Generation by Learning Style Difference and Similarity
    He, Xiao
    Zhu, Mingrui
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (09) : 8013 - 8025
  • [9] Few-shot Font Generation with Localized Style Representations and Factorization
    Park, Song
    Chun, Sanghyuk
    Cha, Junbum
    Lee, Bado
    Shim, Hyunjung
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2393 - 2402
  • [10] CLIP-FONT: SEMENTIC SELF-SUPERVISED FEW-SHOT FONT GENERATION WITH CLIP
    Xiong, Jialu
    Wang, Yefei
    Zeng, Jinshan
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3620 - 3624