3D Face Reconstruction with Geometry Details from a Single Color Image Under Occluded Scenes

被引:0
|
作者
Zhao, Dapeng [1 ]
Qi, Yue [1 ,2 ,3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Beihang Univ, Qingdao Res Inst, Qingdao, Peoples R China
基金
中国国家自然科学基金;
关键词
3D face reconstruction; Face parsing; Occluded scenes; REPRESENTATION;
D O I
10.1007/978-3-031-15931-2_28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D face reconstruction technology aims to generate a face stereo model naturally and realistically. Previous deep face reconstruction approaches are typically designed to generate convincing textures and cannot generalize well to multiple occluded scenarios simultaneously. By introducing bump mapping, we successfully added mid-level details to coarse 3D faces. More innovatively, our method takes into account occlusion scenarios. Thus on top of common 3D face reconstruction approaches, we in this paper propose a unified framework to handle multiple types of obstruction simultaneously (e.g., hair, palms and glasses et al.). Extensive experiments and comparisons demonstrate that our method can generate high-quality reconstruction results with geometry details from captured facial images under occluded scenes.
引用
收藏
页码:332 / 344
页数:13
相关论文
共 50 条
  • [1] Convincing 3D Face Reconstruction from a Single Color Image under Occluded Scenes
    Zhao, Dapeng
    Cai, Jinkang
    Qi, Yue
    [J]. ELECTRONICS, 2022, 11 (04)
  • [2] 3D Face Reconstruction With Geometry Details From a Single Image
    Jiang, Luo
    Zhang, Juyong
    Deng, Bailin
    Li, Hao
    Liu, Ligang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) : 4756 - 4770
  • [3] Generative Face Parsing Map Guided 3D Face Reconstruction Under Occluded Scenes
    Zhao, Dapeng
    Qi, Yue
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2021, 2021, 13002 : 252 - 263
  • [4] Holistic 3D face and head reconstruction with geometric details from a single image
    Lee, Jungwoo
    Lumentut, Jonathan Samuel
    Park, In Kyu
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (26) : 38217 - 38233
  • [5] 3D Face Reconstruction With Texture Details From a Single Image Based On Gan
    Kuang, Hailan
    Ding, Yiran
    Ma, Xiaolin
    Liu, Xinhua
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA 2019), 2019, : 385 - 388
  • [6] Holistic 3D face and head reconstruction with geometric details from a single image
    Jungwoo Lee
    Jonathan Samuel Lumentut
    In Kyu Park
    [J]. Multimedia Tools and Applications, 2022, 81 : 38217 - 38233
  • [7] Bayesian reconstruction of 3D shapes and scenes from a single image
    Han, F
    Zhu, SC
    [J]. FIRST IEEE INTERNATIONAL WORKSHOP ON HIGHER-LEVEL KNOWLEDGE IN 3D MODELING AND MOTION ANALYSIS, PROCEEDINGS, 2003, : 12 - 20
  • [8] Generating Diverse 3D Reconstructions from a Single Occluded Face Image
    Dey, Rahul
    Boddeti, Vishnu Naresh
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1537 - 1547
  • [9] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    [J]. 2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [10] Tensor-based 3D Color Face Reconstruction Using A Single Image
    Cheng, Wen-Po
    Hsiang, Tien-Ruey
    [J]. 2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS & VISION (ICARCV), 2012, : 883 - 888