CLIP-FONT: SEMENTIC SELF-SUPERVISED FEW-SHOT FONT GENERATION WITH CLIP

被引:1
|
作者
Xiong, Jialu [1 ]
Wang, Yefei [2 ]
Zeng, Jinshan [2 ]
机构
[1] Jiangxi Normal Univ, Sch Digital Ind, Shangrao, Peoples R China
[2] Jiangxi Normal Univ, Sch Comp & Informat Engn, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Font generation; few-shot; self-supervision;
D O I
10.1109/ICASSP48485.2024.10447490
中图分类号
学科分类号
摘要
Font design is a very resource-intensive endeavor, especially for intricate fonts. The task of few-shot font generation (FFG) has attracted great interest recently. This method captures style from a limited set of reference glyphs and then transfers it to other characters to generate diverse style fonts. Existing FFG methods mainly revolve around learning font content or style. However, these methods often only learn content or style or lack the ability to represent style and content, resulting in poor font quality. To address these issues, we introduce CLIP-Font-a novel few-shot font generation model. CLIP-Font uses font text semantics for self-supervision to guide font generation at the content level, and uses attention-based contrast learning at the style level to capture the representation capabilities of the font fine-grained style enhancement model. Experimental results on various datasets demonstrate the effectiveness of our method, surpassing the performance of existing FFG techniques.
引用
收藏
页码:3620 / 3624
页数:5
相关论文
共 50 条
  • [31] Fine-Tuning of CLIP in Few-Shot Scenarios via Supervised Contrastive Learning
    Luo, Jing
    Wu, Guangxing
    Liu, Hongmei
    Wang, Ruixuan
    PATTERN RECOGNITION AND COMPUTER VISION, PT III, PRCV 2024, 2025, 15033 : 104 - 117
  • [32] CLIP-FSAC: Boosting CLIP for Few-Shot Anomaly Classification with Synthetic Anomalies
    Zuo, Zuo
    Wu, Yao
    Li, Baoqiang
    Dong, Jiahao
    Zhou, You
    Zhou, Lei
    Qu, Yanyun
    Wu, Zongze
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 1834 - 1842
  • [33] A CLIP Guided Model for Few-Shot Object Detection
    Sun, Chang
    Li, Yuehua
    Xing, Yan
    Zhang, Weidong
    Ai, Yibo
    Wang, Sheng
    Li, Chao
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT VII, 2025, 15207 : 3 - 17
  • [34] Self-Supervised Learning for Few-Shot Medical Image Segmentation
    Ouyang, Cheng
    Biffi, Carlo
    Chen, Chen
    Kart, Turkay
    Qiu, Huaqi
    Rueckert, Daniel
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) : 1837 - 1848
  • [35] HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution
    Li, Hua
    Lian, Zhouhui
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (06):
  • [36] Self-supervised Prototype Conditional Few-Shot Object Detection
    Kobayashi, Daisuke
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT II, 2022, 13232 : 681 - 692
  • [37] Few-Shot Hyperspectral Image Classification With Self-Supervised Learning
    Li, Zhaokui
    Guo, Hui
    Chen, Yushi
    Liu, Cuiwei
    Du, Qian
    Fang, Zhuoqun
    Wang, Yan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [38] Multi-task Self-supervised Few-Shot Detection
    Zhang, Guangyong
    Duan, Lijuan
    Wang, Wenjian
    Gong, Zhi
    Ma, Bian
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XII, 2024, 14436 : 107 - 119
  • [39] Self-Supervised Task Augmentation for Few-Shot Intent Detection
    Peng-Fei Sun
    Ya-Wen Ouyang
    Ding-Jie Song
    Xin-Yu Dai
    Journal of Computer Science and Technology, 2022, 37 : 527 - 538
  • [40] SELF-SUPERVISED CLASS-COGNIZANT FEW-SHOT CLASSIFICATION
    Shirekar, Ojas Kishore
    Jamali-Rad, Hadi
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 976 - 980