Fine-grained 3D Face Reconstruction from a Single Image using Illumination Priors

被引:0
|
作者
Qiu, Weibin [1 ]
Yu, Yao [1 ]
Zhou, Yu [1 ]
Du, Sidan [1 ]
机构
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing, Peoples R China
关键词
3D Face Reconstruction; Morphable Model; Illumination Priors; Shape-from-Shading; SHAPE;
D O I
10.5220/0007406508760883
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D face reconstruction has a wide range of applications, but it is still a challenging problem, especially when dealing with a single image. Inspired by recent works in face illumination estimation and face animation from video, we propose a novel method for 3D face renconstruction with geometric details from a single image by using three steps. First, a coarse 3D face is generated in morphable model space by landmarks alignment. Afterwards, using the face illumination priors and surface normals generated from the coarse 3D face, we estimate both illumination condition and facial texture, making it possible for the final step that refines geometric details through shape-from-shading method. Experiments prove that our method outperforms state-of-the-art method in terms of accuracy and geometric preservation.
引用
收藏
页码:876 / 883
页数:8
相关论文
共 50 条
  • [1] Coarse to Fine 3D Face Reconstruction from Single Image
    Galteri, L.
    Ferrari, C.
    Lisanti, G.
    Berretti, S.
    Del Bimbo, A.
    [J]. 2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 745 - 745
  • [2] 3D Guided Fine-Grained Face Manipulation
    Geng, Zhenglin
    Cao, Chen
    Tulyakov, Sergey
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9813 - 9822
  • [3] 3D Face Reconstruction from a Single Image Using a Single Reference Face Shape
    Kemelmacher-Shlizerman, Ira
    Basri, Ronen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) : 394 - 405
  • [4] Self-supervised learning for fine-grained monocular 3D face reconstruction in the wild
    Huang, Dongjin
    Shi, Yongsheng
    Liu, Jinhua
    Tang, Wen
    [J]. MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [5] Fine-grained metals from 3D printing
    Clarke, Amy J.
    [J]. NATURE, 2019, 576 (7785) : 41 - 42
  • [6] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    [J]. 2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [7] Reconstructing 3D Shape, Albedo and Illumination from a Single Face Image
    Wang, S. F.
    Lai, S. H.
    [J]. COMPUTER GRAPHICS FORUM, 2008, 27 (07) : 1729 - 1736
  • [8] 3D Reconstruction from a Single Image for a Chinese Talking Face
    Liu, Ning
    Fang, Ning
    Kamata, Seiichiro
    [J]. TENCON 2010: 2010 IEEE REGION 10 CONFERENCE, 2010, : 1613 - 1616
  • [9] Dense 3D Face Reconstruction from a Single RGB Image
    Mao, Jianxu
    Zhang, Yifeng
    Liu, Caiping
    Tao, Ziming
    Yi, Junfei
    Wang, Yaonan
    [J]. 2022 IEEE 25TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING, CSE, 2022, : 24 - 31
  • [10] 3D Face Reconstruction With Geometry Details From a Single Image
    Jiang, Luo
    Zhang, Juyong
    Deng, Bailin
    Li, Hao
    Liu, Ligang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) : 4756 - 4770