CLIP-FONT: SEMENTIC SELF-SUPERVISED FEW-SHOT FONT GENERATION WITH CLIP

被引:1
|
作者
Xiong, Jialu [1 ]
Wang, Yefei [2 ]
Zeng, Jinshan [2 ]
机构
[1] Jiangxi Normal Univ, Sch Digital Ind, Shangrao, Peoples R China
[2] Jiangxi Normal Univ, Sch Comp & Informat Engn, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Font generation; few-shot; self-supervision;
D O I
10.1109/ICASSP48485.2024.10447490
中图分类号
学科分类号
摘要
Font design is a very resource-intensive endeavor, especially for intricate fonts. The task of few-shot font generation (FFG) has attracted great interest recently. This method captures style from a limited set of reference glyphs and then transfers it to other characters to generate diverse style fonts. Existing FFG methods mainly revolve around learning font content or style. However, these methods often only learn content or style or lack the ability to represent style and content, resulting in poor font quality. To address these issues, we introduce CLIP-Font-a novel few-shot font generation model. CLIP-Font uses font text semantics for self-supervision to guide font generation at the content level, and uses attention-based contrast learning at the style level to capture the representation capabilities of the font fine-grained style enhancement model. Experimental results on various datasets demonstrate the effectiveness of our method, surpassing the performance of existing FFG techniques.
引用
收藏
页码:3620 / 3624
页数:5
相关论文
共 50 条
  • [41] Self-Supervised Approach for Few-shot Hand Gesture Recognition
    Kimura, Naoki
    ADJUNCT PROCEEDINGS OF THE 35TH ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2022, 2022,
  • [42] SELF-SUPERVISED LEARNING FOR FEW-SHOT BIRD SOUND CLASSIFICATION
    Moummad, Ilyass
    Farrugia, Nicolas
    Serizel, Romain
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW 2024, 2024, : 600 - 604
  • [43] Self-Supervised Task Augmentation for Few-Shot Intent Detection
    Sun, Peng-Fei
    Ouyang, Ya-Wen
    Song, Ding-Jie
    Dai, Xin-Yu
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2022, 37 (03) : 527 - 538
  • [44] A Self-supervised GAN for Unsupervised Few-shot Object Recognition
    Nguyen, Khoi
    Todorovic, Sinisa
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3225 - 3231
  • [45] Multi-Content GAN for Few-Shot Font Style Transfer
    Azadil, Samaneh
    Fisher, Matthew
    Kim, Vladimir
    Wang, Zhaowen
    Shechtman, Eli
    Darrell, Trevor
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7564 - 7573
  • [46] Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Experts
    Park, Song
    Chun, Sanghyuk
    Cha, Junbum
    Lee, Bado
    Shim, Hyunjung
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13880 - 13889
  • [47] JointFontGAN: Joint Geometry-Content GAN for Font Generation via Few-Shot Learning
    Xi, Yankun
    Yan, Guoli
    Hua, Jing
    Zhong, Zichun
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4309 - 4317
  • [48] Adversarial domain adaptation with CLIP for few-shot image classification
    Sun, Tongfeng
    Yang, Hongjian
    Li, Zhongnian
    Xu, Xinzheng
    Wang, Xiurui
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [49] Exploring the Adaptation Strategy of CLIP for Few-Shot Action Recognition
    Cao, Congqi
    Zhang, Yueran
    Lv, Qinyi
    Min, Lingtong
    Zhang, Yanning
    PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON EFFICIENT MULTIMEDIA COMPUTING UNDER LIMITED RESOURCES, EMCLR 2024, 2024, : 39 - 48
  • [50] SELF-SUPERVISED FEW-SHOT LEARNING FOR ISCHEMIC STROKE LESION SEGMENTATION
    Tomasetti, Luca
    Hansen, Stine
    Khanmohammadi, Mahdieh
    Engan, Kjersti
    Hollesli, Liv Jorunn
    Kurz, Kathinka Daehli
    Kampffmeyer, Michael
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,