HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution

被引:1
|
作者
Li, Hua [1 ]
Lian, Zhouhui [1 ,2 ,3 ]
机构
[1] Peking Univ, Wangxuan Inst Comp Technol, Beijing, Peoples R China
[2] Peking Univ, Beijing, Peoples R China
[3] State Key Lab Gen Artificial Intelligence, Beijing, Peoples R China
来源
ACM TRANSACTIONS ON GRAPHICS | 2024年 / 43卷 / 06期
基金
中国国家自然科学基金;
关键词
Image synthesis; font generation; style transfer; deep generative models; diffusion models; deep learning;
D O I
10.1145/3687994
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The challenge of automatically synthesizing high-quality vector fonts, par-ticularly for writing systems (e.g., Chinese) consisting of huge amounts ofcomplex glyphs, remains unsolved. Existing font synthesis techniques fallinto two categories: 1) methods that directly generate vector glyphs, and2) methods that initially synthesize glyph images and then vectorize them.However, the first category often fails to construct complete and correctshapes for complex glyphs, while the latter struggles to efficiently synthesizehigh-resolution (i.e., 1024x1024 or higher) glyph images while preservinglocal details. In this paper, we introduce HFH-Font, a few-shot font synthe-sis method capable of efficiently generating high-resolution glyph imagesthat can be converted into high-quality vector glyphs. More specifically,our method employs a diffusion model-based generative framework with component-aware conditioning to learn different levels of style informationadaptable to varying input reference sizes. We also design a distillationmodule based on Score Distillation Sampling for 1-step fast inference, and astyle-guided super-resolution module to refine and upscale low-resolutionsynthesis results. Extensive experiments, including a user study with profes-sional font designers, have been conducted to demonstrate that our methodsignificantly outperforms existing font synthesis approaches. Experimentalresults show that our method produces high-fidelity, high-resolution rasterimages which can be vectorized into high-quality vector fonts. Using ourmethod, for the first time, large-scale Chinese vector fonts of a quality com-parable to those manually created by professional font designers can beautomatically generated.
引用
收藏
页数:16
相关论文
共 4 条
  • [1] DeepCalliFont: Few-Shot Chinese Calligraphy Font Synthesis by Integrating Dual-Modality Generative Models
    Liu, Yitian
    Lian, Zhouhui
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3774 - 3782
  • [2] MLFont: Few-Shot Chinese Font Generation via Deep Meta-Learning
    Chen, Xu
    Wu, Lei
    He, Minggang
    Meng, Lei
    Meng, Xiangxu
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, : 37 - 45
  • [3] ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach
    Wen, Qi
    Li, Shuang
    Han, Bingfeng
    Yuan, Yi
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 621 - 629
  • [4] FontTransformer: Few-shot high-resolution Chinese glyph image synthesis via stacked transformers
    Liu, Yitian
    Lian, Zhouhui
    PATTERN RECOGNITION, 2023, 141