Real-Time Exemplar-Based Face Sketch Synthesis

被引:0
|
作者
Song, Yibing [1 ]
Bao, Linchao [1 ]
Yang, Qingxiong [1 ]
Yang, Ming-Hsuan [2 ]
机构
[1] City Univ Hong Kong, Multimedia Software Engn Res Ctr MERC, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[2] Univ Calif Merced, Dept Elect Engn & Comp Sci, Merced, CA USA
来源
关键词
Face Hallucination; Texture Synthesis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a simple yet effective face sketch synthesis method. Similar to existing exemplar-based methods, a training dataset containing photo-sketch pairs is required, and a K-NN photo patch search is performed between a test photo and every training exemplar for sketch patch selection. Instead of using the Markov Random Field to optimize global sketch patch selection, this paper formulates face sketch synthesis as an image denoising problem which can be solved efficiently using the proposed method. Real-time performance can be obtained on a state-of-the-art GPU. Meanwhile quantitative evaluations on face sketch recognition and user study demonstrate the effectiveness of the proposed method. In addition, the proposed method can be directly extended to the temporal domain for consistent video sketch synthesis, which is of great importance in digital entertainment.
引用
收藏
页码:800 / 813
页数:14
相关论文
共 50 条
  • [1] FCN based preprocessing for exemplar-based face sketch synthesis
    Lu, Dan
    Chen, Zhenxue
    Wu, Q. M. Jonathan
    Zhang, Xuetao
    NEUROCOMPUTING, 2019, 365 : 113 - 124
  • [2] SPEECH SEGMENT CLUSTERING FOR REAL-TIME EXEMPLAR-BASED SPEECH ENHANCEMENT
    Nesbitt, David
    Crookes, Danny
    Ming, Ji
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 5419 - 5423
  • [3] A Parallel Depth-aided Exemplar-based Inpainting for Real-time View Synthesis on GPU
    Tian, Zheng
    Xu, Cheng
    Deng, Xiaoyun
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 1739 - 1744
  • [4] Exemplar-Based Face Parsing
    Smith, Brandon M.
    Zhang, Li
    Brandt, Jonathan
    Lin, Zhe
    Yang, Jianchao
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 3484 - 3491
  • [5] DualStyle3D: Real-time Exemplar-based Artistic Portrait View Synthesis Based on Radiance Field
    Hao, Runlai
    Li, Jinlong
    Chen, Qiuju
    Chen, Huanhuan
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 869 - 877
  • [6] Exemplar-based face recognition from video
    Krüger, V
    Zhou, SH
    FIFTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2002, : 182 - 187
  • [7] Efficient Boosted Exemplar-based Face Detection
    Li, Haoxiang
    Lin, Zhe
    Brandt, Jonathan
    Shen, Xiaohui
    Hua, Gang
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1843 - 1850
  • [8] Exemplar-based models of face recognition.
    Busey, TA
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 1998, 42 (04) : 494 - 494
  • [9] Exemplar-based face recognition from video
    Krüger, V
    Zhou, SH
    COMPUTER VISION - ECCV 2002, PT IV, 2002, 2353 : 732 - 746
  • [10] Exemplar-based face and facial motion tracking
    Huang, TS
    Hong, PY
    2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-IV, PROCEEDINGS, 2002, : 3600 - 3603