Noniterative 3D face reconstruction based on photometric stereo

被引:24
|
作者
Lee, Sang-Woong [2 ]
Wang, Patrick S. P. [3 ]
Yanushkevich, Svetlana N. [4 ]
Lee, Seong-Whan [1 ]
机构
[1] Korea Univ, Div Comp & Commun Engn, Seoul 136713, South Korea
[2] Chosun Univ, Dept Comp Sci & Engn, Kwangju 501759, South Korea
[3] NE Univ, Coll Comp & Informat Sci, Boston, MA 02115 USA
[4] Univ Calgary, Schulich Sch Engn, Dept Elect & Comp Engn, Calgary, AB T2N 1N4, Canada
关键词
3D face reconstruction; illuminated exemplar; photometric stereo; face synthesis;
D O I
10.1142/S0218001408006272
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D face reconstruction is a popular area within the computer vision domain. 3D face reconstruction should ideally be achieved easily and cost-effectively, without requiring specialized equipment to estimate 3D shapes. As a result of this, many techniques for retrieving 3D shapes from 2D images have been proposed. In this paper, a novel method for 3D face reconstruction based on photometric stereo, which estimates the surface normal from shading information in multiple images, hence recovering the 3D shape of a face, is proposed. In order to overcome the problems of previous approaches related to prior-knowledge regarding lighting conditions and iterative algorithms, the exemplar is synthesized with known lighting conditions from at least three images, under arbitrary lighting conditions and using an illumination reference. Experiments in 3D face reconstruction were made by verifying the proposed approach using the illumination subset of the Max-Planck Institute face database and Yale face database B. Experimental results demonstrate that the proposed method is effective for 3D shape reconstruction of faces from 2D images.
引用
收藏
页码:389 / 410
页数:22
相关论文
共 50 条
  • [1] Accurate 3D Reconstruction of Face Image Based on Photometric Stereo
    Lei, Yongqing
    Sun, Yujuan
    Wu, Zeju
    Wang, Zengfeng
    [J]. COMPUTATIONAL INTELLIGENCE AND INTELLIGENT SYSTEMS, (ISICA 2015), 2016, 575 : 418 - 423
  • [2] Fast 3D face reconstruction based on uncalibrated photometric stereo
    Yujuan Sun
    Junyu Dong
    Muwei Jian
    Lin Qi
    [J]. Multimedia Tools and Applications, 2015, 74 : 3635 - 3650
  • [3] Fast 3D face reconstruction based on uncalibrated photometric stereo
    Sun, Yujuan
    Dong, Junyu
    Jian, Muwei
    Qi, Lin
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (11) : 3635 - 3650
  • [4] The Photometric Stereo Approach and the Visualization of 3D Face Reconstruction
    Khan, Muhammad Sajid
    Ullah, Zabeeh
    Butt, Maria Shahid
    Arshad, Zohaib
    Yousaf, Sobia
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (02) : 217 - 221
  • [5] 3D Reconstruction of Tongue Surface based on Photometric Stereo
    Lv, Huijuan
    Cai, Yiheng
    Guo, Song
    [J]. PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, : 1668 - 1671
  • [6] Photometric Stereo for 3D Face Reconstruction Using Non Linear Illumination Models
    Villarini, Barbara
    Gkelias, Athanasios
    Argyriou, Vasilios
    [J]. MULTIMODAL PATTERN RECOGNITION OF SOCIAL SIGNALS IN HUMAN-COMPUTER-INTERACTION, MPRSS 2016, 2017, 10183 : 140 - 152
  • [7] Object 3D Reconstruction based on Photometric Stereo and Inverted Rendering
    Khadka, Anish R.
    Remagnino, Paolo
    Argyriou, Vasileios
    [J]. 2018 14TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS), 2018, : 208 - 215
  • [8] A Stereo Matching based 3D Face Reconstruction Algorithm
    Fu, Youcheng
    Da, Feipeng
    [J]. PROCEEDINGS OF THE 2008 CHINESE CONFERENCE ON PATTERN RECOGNITION (CCPR 2008), 2008, : 256 - 261
  • [9] 3D Face Reconstruction using Color Photometric Stereo with Uncalibrated Near Point Lights
    Chen, Zhang
    Ji, Yu
    Zhou, Mingyuan
    Kang, Sing Bing
    Yu, Jingyi
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2020,
  • [10] Dynamic 3D Reconstruction of Tongue Surface Based on Photometric Stereo Technique
    Cai, Yiheng
    Zhang, Linlin
    Sheng, Nan
    Wang, Lina
    Zhang, Xinfeng
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2015, PT I, 2015, 9244 : 462 - 472