Semi-supervised reference-based sketch extraction using a contrastive learning framework

被引:4
|
作者
Seo, Chang Wook [1 ]
Ashtari, Amirsaman [1 ]
Noh, Junyong [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Visual Media Lab, Daejeon, South Korea
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 04期
关键词
Sketch-extraction; Auto-colorization; Image-to-image translation;
D O I
10.1145/3592392
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Sketches reflect the drawing style of individual artists; therefore, it is important to consider their unique styles when extracting sketches from color images for various applications. Unfortunately, most existing sketch extraction methods are designed to extract sketches of a single style. Although there have been some attempts to generate various style sketches, the methods generally suffer from two limitations: low quality results and difficulty in training the model due to the requirement of a paired dataset. In this paper, we propose a novel multi-modal sketch extraction method that can imitate the style of a given reference sketch with unpaired data training in a semi-supervised manner. Our method outperforms state-of-the-art sketch extraction methods and unpaired image translation methods in both quantitative and qualitative evaluations.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Probabilistic Contrastive Framework for Semi-Supervised Learning
    Lin, Huibin
    Zhang, Chun-Yang
    Wang, Shiping
    Guo, Wenzhong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8767 - 8779
  • [2] CONTRASTIVE SEMI-SUPERVISED LEARNING FOR ASR
    Xiao, Alex
    Fuegen, Christian
    Mohamed, Abdelrahman
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3870 - 3874
  • [3] Contrastive Regularization for Semi-Supervised Learning
    Lee, Doyup
    Kim, Sungwoong
    Kim, Ildoo
    Cheon, Yeongjae
    Cho, Minsu
    Han, Wook-Shin
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3910 - 3919
  • [4] Semi-supervised learning framework for crack segmentation based on contrastive learning and cross pseudo supervision
    Xiang, Chao
    Gan, Vincent J. L.
    Guo, Jingjing
    Deng, Lu
    [J]. MEASUREMENT, 2023, 217
  • [5] A Transformer-Based Contrastive Semi-Supervised Learning Framework for Automatic Modulation Recognition
    Kong, Weisi
    Jiao, Xun
    Xu, Yuhua
    Zhang, Bolin
    Yang, Qinghai
    [J]. IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (04) : 950 - 962
  • [6] Multi-Augmentation-Based Contrastive Learning for Semi-Supervised Learning
    Wang, Jie
    Yang, Jie
    He, Jiafan
    Peng, Dongliang
    [J]. ALGORITHMS, 2024, 17 (03)
  • [7] A Semi-supervised Classification Method of Parasites Using Contrastive Learning
    Ren, Yanni
    Jiang, Hao
    Zhu, Huilin
    Tian, Yanling
    Hu, Jinglu
    [J]. IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2022, 17 (03) : 445 - 453
  • [8] Semi-Supervised Group Emotion Recognition Based on Contrastive Learning
    Zhang, Jiayi
    Wang, Xingzhi
    Zhang, Dong
    Lee, Dah-Jye
    [J]. ELECTRONICS, 2022, 11 (23)
  • [9] FedFAME: A Data Augmentation Free Framework based on Model Contrastive Learning for Federated Semi-Supervised Learning
    Malaviya, Shubham
    Shukla, Manish
    Korat, Pratik
    Lodha, Sachin
    [J]. 38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, 2023, : 1114 - 1121
  • [10] A semi-supervised learning framework for biomedical event extraction based on hidden topics
    Zhou, Deyu
    Zhong, Dayou
    [J]. ARTIFICIAL INTELLIGENCE IN MEDICINE, 2015, 64 (01) : 51 - 58