CLIP-FONT: SEMENTIC SELF-SUPERVISED FEW-SHOT FONT GENERATION WITH CLIP

被引:1
|
作者
Xiong, Jialu [1 ]
Wang, Yefei [2 ]
Zeng, Jinshan [2 ]
机构
[1] Jiangxi Normal Univ, Sch Digital Ind, Shangrao, Peoples R China
[2] Jiangxi Normal Univ, Sch Comp & Informat Engn, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Font generation; few-shot; self-supervision;
D O I
10.1109/ICASSP48485.2024.10447490
中图分类号
学科分类号
摘要
Font design is a very resource-intensive endeavor, especially for intricate fonts. The task of few-shot font generation (FFG) has attracted great interest recently. This method captures style from a limited set of reference glyphs and then transfers it to other characters to generate diverse style fonts. Existing FFG methods mainly revolve around learning font content or style. However, these methods often only learn content or style or lack the ability to represent style and content, resulting in poor font quality. To address these issues, we introduce CLIP-Font-a novel few-shot font generation model. CLIP-Font uses font text semantics for self-supervision to guide font generation at the content level, and uses attention-based contrast learning at the style level to capture the representation capabilities of the font fine-grained style enhancement model. Experimental results on various datasets demonstrate the effectiveness of our method, surpassing the performance of existing FFG techniques.
引用
收藏
页码:3620 / 3624
页数:5
相关论文
共 50 条
  • [1] Font transformer for few-shot font generation
    Chen, Xu
    Wu, Lei
    Su, Yongliang
    Meng, Lei
    Meng, Xiangxu
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 245
  • [2] XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generation
    Liu, Wei
    Liu, Fangyue
    Ding, Fei
    He, Qian
    Yi, Zili
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7895 - 7904
  • [3] Few-Shot Font Generation With Weakly Supervised Localized Representations
    Park, Song
    Chun, Sanghyuk
    Cha, Junbum
    Lee, Bado
    Shim, Hyunjung
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1479 - 1495
  • [4] CF-Font: Content Fusion for Few-shot Font Generation
    Wang, Chi
    Zhou, Min
    Ge, Tiezheng
    Jiang, Yuning
    Bao, Hujun
    Xu, Weiwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1858 - 1867
  • [5] FA-Font: Feature Aggregation for Few-shot Font Generation
    Lv, Guojin
    Zhao, Hongyu
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON ALGORITHMS, SOFTWARE ENGINEERING, AND NETWORK SECURITY, ASENS 2024, 2024, : 254 - 261
  • [6] Few-Shot Content-Level Font Generation
    Majeed, Saima
    Ul Hassan, Ammar
    Choi, Jaeyoung
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (04): : 1166 - 1186
  • [7] Few-Shot Font Generation with Deep Metric Learning
    Aoki, Haruka
    Tsubota, Koki
    Ikuta, Hikaru
    Aizawa, Kiyoharu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8539 - 8546
  • [8] MA-Font: Few-Shot Font Generation by Multi-Adaptation Method
    Qiu, Yanbo
    Chu, Kaibin
    Zhang, Ji
    Feng, Chengtao
    IEEE ACCESS, 2024, 12 : 60765 - 60781
  • [9] VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization
    Yao, Mingshuai
    Zhang, Yabo
    Lin, Xianhui
    Li, Xiaoming
    Zuo, Wangmeng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16407 - 16415
  • [10] Few-Shot Font Generation by Learning Style Difference and Similarity
    He, Xiao
    Zhu, Mingrui
    Wang, Nannan
    Gao, Xinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (09) : 8013 - 8025