LEARNING-BASED FULLY 3D FACE RECONSTRUCTION FROM A SINGLE IMAGE

被引:0
|
作者
Hu, Xiaoping [1 ]
Wang, Ying [1 ]
Zhu, Feiyun [1 ]
Pan, Chunhong [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100864, Peoples R China
关键词
3D Morphable model; face alignment; deform transfer; full reconstruction; sparse learning; MORPHABLE MODEL; RECOGNITION;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper presents an algorithm for fully reconstructing a 3D face from a single image. This task is still highly challenging as most current methods only care about the frontal face, ignoring side face, such as the neck, ears etc. In our algorithm, to get the more detailed texture, we deal with the shape reconstruction and texture recovery respectively. For shape, we estimate the deformation of the 3D model by a set of feature points. For texture, due to the similar facial structure, we divide the full texture into patches and show how sparse learning model can be used to fully recover the texture of the 3D face. Extensive experiment results on the CMU-PIE database and images downloaded from the Internet demonstrate that our method outperforms the state-of-the-art methods.
引用
收藏
页码:1651 / 1655
页数:5
相关论文
共 50 条
  • [1] 3D Face Reconstruction Based on a Single Image: A Review
    Diao, Haojie
    Jiang, Xingguo
    Fan, Yang
    Li, Ming
    Wu, Hongcheng
    [J]. IEEE ACCESS, 2024, 12 : 59450 - 59473
  • [2] Learning-based 3D surface optimization from medical image reconstruction
    Wei, Mingqiang
    Wang, Jun
    Guo, Xianglin
    Wu, Huisi
    Xie, Haoran
    Wang, Fu Lee
    Qin, Jing
    [J]. OPTICS AND LASERS IN ENGINEERING, 2018, 103 : 110 - 118
  • [3] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    [J]. 2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [4] Learning 3D face reconstruction from a single sketch*
    Yang, Li
    Wu, Jing
    Huo, Jing
    Lai, Yu-Kun
    Gao, Yang
    [J]. GRAPHICAL MODELS, 2021, 115
  • [5] Learning-detailed 3D face reconstruction based on convolutional neural networks from a single image
    Asad Khan
    Sakander Hayat
    Muhammad Ahmad
    Jinde Cao
    Muhammad Faizan Tahir
    Asad Ullah
    Muhammad Sufyan Javed
    [J]. Neural Computing and Applications, 2021, 33 : 5951 - 5964
  • [6] Learning-detailed 3D face reconstruction based on convolutional neural networks from a single image
    Khan, Asad
    Hayat, Sakander
    Ahmad, Muhammad
    Cao, Jinde
    Tahir, Muhammad Faizan
    Ullah, Asad
    Javed, Muhammad Sufyan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (11): : 5951 - 5964
  • [7] Research on 3D Reconstruction of Human Face Based on Single Image
    Zhang, Chaoying
    Su, Minglan
    Liu, Qiaoqiao
    Liang, Baolin
    Wang, Jianxiu
    [J]. 2021 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, INFORMATION AND COMMUNICATION ENGINEERING, 2021, 11933
  • [8] 3D Face Reconstruction With Texture Details From a Single Image Based On Gan
    Kuang, Hailan
    Ding, Yiran
    Ma, Xiaolin
    Liu, Xinhua
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA 2019), 2019, : 385 - 388
  • [9] 3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
    Kemelmacher-Shlizerman, Ira
    Basri, Ronen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) : 394 - 405
  • [10] Coarse to Fine 3D Face Reconstruction from Single Image
    Galteri, L.
    Ferrari, C.
    Lisanti, G.
    Berretti, S.
    Del Bimbo, A.
    [J]. 2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 745 - 745