Shape from shading-based 3D face shape recovery fiom single 2D image

被引:0
|
作者
Li, Fenlan [1 ]
Xu, Kexin [1 ]
机构
[1] Tianjin Univ, State Key Lab Precis Measuring Technol & Instrume, Tianjin 300072, Peoples R China
关键词
face recognition (FR); shape from shading (SFS); Lambertian reflector; face shape; albedo; reflectance function;
D O I
10.1117/12.710741
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
3D depth information of a face, which does not vary under different exterior conditions, provides an excellent clue to current face recognition (FR) research. Among techniques of 3D shape recovery, shape from shading (SFS) method which can recover from single 2D image is most popular. However, most existing SFS algorithms assume that objects in the scene are Lambertian reflectors and the reflectivity of the object's surface is uniform, which makes it difficult to reconstruct the face shape successfully and accurately, mainly because the face not only has a complex shape but also is composed of parts with different reflecting properties such as cheek and lip. In this paper, an improved algorithm is proposed. The strategy consists in: 1) according to face's shape and albedo symmetry, an albedo free reflectance function is derived; 2) through an eye detector, the 2D face image being measured is aligned to a 3D face model; 3) the iteration equation for computation of the depth value is obtained and the 3D depth information of the model is set as initial depth value of the face shape. Through continuously iteration until convergence, the 3D depth information of the face is achieved lastly; 4) based on the depth values calculated, the pixel-wise albedo value is also obtained. Experiments are carried out on symmetry objects and real face images. Results show that the proposed SFS algorithm can efficiently accomplish face's 3D shape recovery in less time and at less iteration.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] Example-based shape from shading: 3D heads form 2D face images
    Kouzani, AZ
    He, F
    Sammut, K
    1998 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5, 1998, : 4092 - 4097
  • [2] Fast and Precise Face Alignment and 3D Shape Reconstruction from a Single 2D Image
    Zhao, Ruiqi
    Wang, Yan
    Benitez-Quiroz, C. Fabian
    Liu, Yaojie
    Martinez, Aleix M.
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 : 590 - 603
  • [3] Regressing a 3D Face Shape from a Single Image
    Tulyakov, Sergey
    Sebe, Nicu
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3748 - 3755
  • [4] 3D Shape Retrieval from a 2D Image as Query
    Aono, Masaki
    Iwabuchi, Hiroki
    2012 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2012,
  • [5] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [6] 3D face modeling from single image based on discrete shape space
    Zhang, Dan
    Lv, Chenglei
    Liu, Na
    Wu, Zhongke
    Wang, Xingce
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2020, 31 (4-5)
  • [7] X-ray2Shape: Reconstruction of 3D Liver Shape from a Single 2D Projection Image
    Tong, Fei
    Nakao, Megumi
    Wu, Shuqiong
    Nakamura, Mitsuhiro
    Matsuda, Tetsuya
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 1608 - 1611
  • [8] Shading-based Shape Refinement of RGB-D Images
    Yu, Lap-Fai
    Yeung, Sai-Kit
    Tai, Yu-Wing
    Lin, Stephen
    2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1415 - 1422
  • [9] Creation of a 3D shape for the proximal femur from a single 2D radiographic image
    Pisharody, S.
    Phillips, R.
    Langton, C. M.
    CALCIFIED TISSUE INTERNATIONAL, 2008, 83 (01) : 20 - 21
  • [10] 3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
    Kemelmacher-Shlizerman, Ira
    Basri, Ronen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) : 394 - 405