Improved 3D face reconstruction from stereo images

被引:0
|
作者
Yu, Jian [1 ,2 ]
Da, Feipeng [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Jiangsu, Peoples R China
[2] Minist Educ, Key Lab Measurement & Control Complex Syst Engn, Nanjing 210096, Jiangsu, Peoples R China
关键词
Stereo Matching; 3D Face Reconstruction; Disparity Estimation; Facial Landmarks;
D O I
10.1117/12.2500460
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents an approach for stereo-based 3D face reconstruction. Our approach is based on depth estimation of the face by using the stereo image pair, requiring neither expensive devices nor generic face models. In order to improve the depth estimation, our approach incorporates face properties to enhance the 3D face reconstruction. The approach starts with a sparse disparity map with 68 facial landmarks detected by dlib toolkit. Considering the face symmetry and smoothness, we complete the dense disparity estimation with the guidance of the sparse disparity map. Post-processing is implemented including outliers removal and surface mesh. Experimental results provided show that the algorithm is promising.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] A 3D Reconstruction Method Based on Images Dense Stereo Matching
    Jiang Ze-tao
    Zheng Bi-na
    Wu Min
    Chen Zhong-xiang
    THIRD INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTING, 2009, : 319 - 323
  • [42] 3D reconstruction using an uncalibrated stereo pair of encoded images
    Lavoie, P
    Ionescu, D
    Petriu, E
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL II, 1996, : 859 - 862
  • [43] 3D Face Reconstruction From A Single Image Assisted by 2D Face Images in the Wild
    Tu, Xiaoguang
    Zhao, Jian
    Xie, Mei
    Jiang, Zihang
    Balamurugan, Akshaya
    Luo, Yao
    Zhao, Yang
    He, Lingxiao
    Ma, Zheng
    Feng, Jiashi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) : 1160 - 1172
  • [44] 3D shape reconstruction from autostereograms and stereo
    Kimmel, R
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2002, 13 (1-2) : 324 - 333
  • [45] Evaluation of Dense 3D Reconstruction from 2D Face Images in the Wild
    Feng, Zhen-Hua
    Huber, Patrik
    Kittler, Josef
    Hancock, Peter
    Wu, Xiao-Jun
    Zhao, Qijun
    Koppen, Paul
    Raetsch, Matthias
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 780 - 786
  • [46] A quantitative comparison of methods for 3D face reconstruction from 2D images
    Morales, Araceli
    Piella, Gemma
    Martinez, Oriol
    Sukno, Federico M.
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 731 - 738
  • [47] 3D Face Reconstruction based on Multi-View Stereo Algorithm
    Peng, Keju
    Guan, Tao
    Xu, Chao
    Zhou, Dongxiang
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS IEEE-ROBIO 2014, 2014, : 2310 - 2314
  • [48] 3D face reconstruction based on the improved morphable model
    Hu, Y.-L. (huyongli@emails.bjut.edu.cn), 1671, Science Press (28):
  • [49] 3D reconstruction of skin surface from photometric stereo images with specular reflection and interreflection
    Matsumoto, Atsuyuki
    Saito, Hideo
    Ozawa, Shinji
    Electrical Engineering in Japan (English translation of Denki Gakkai Ronbunshi), 1999, 129 (03): : 51 - 58
  • [50] 3D reconstruction of skin surface from photometric stereo images with specular reflection and interreflection
    Matsumoto, A
    Saito, H
    Ozawa, S
    ELECTRICAL ENGINEERING IN JAPAN, 1999, 129 (03) : 51 - 58