3D Facial Reconstruction from a Single Image Using a Hybrid Model Based on 3DMM and Deep Learning

被引:0
|
作者
Deshmukh, Isha [1 ]
Tripathi, Vikas [1 ]
Gangodkar, Durgaprasad [1 ]
机构
[1] Graph Era Deemed Be Univ, Dehra Dun, Uttarakhand, India
关键词
3D Facial Reconstruction; 3D Morphable Model; Face Detection; Facial Landmark Detection; Face Model Fitting; FACE RECONSTRUCTION;
D O I
10.1007/978-3-031-53830-8_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A fundamental challenge in computer vision is accurately modelling 3D faces from images. It facilitates the creation of immersive virtual experiences, realistic facial animations, and reliable identity verification. This research introduces an innovative approach aimed at reconstructing intricate facial attributes, encompassing shape, pose, and expression from a single input image. The proposed methodology employs a fusion of two potent techniques: 3D Morphable Models (3DMMs) and advanced Deep Learning (DL) methodologies. By integrating DL into tasks like face detection, expression analysis, and landmark extraction, the framework excels in reconstructing realistic facial attributes from single images even in diverse environments. The framework achieves compelling results in reconstructing "in-the-wild" faces, exhibiting notable fidelity while preserving essential facial characteristics. Experimental evaluations confirm the effectiveness and robustness of our approach, confirming its adaptability across various scenarios. Our research contributes to the advancement of 3Dface modelling techniques, addressing the challenges of accurate reconstruction and holding promise for applications in virtual reality, facial animation, medical, security, and biometrics.
引用
收藏
页码:115 / 126
页数:12
相关论文
共 50 条
  • [1] Detail 3D Face Reconstruction Based on 3DMM and Displacement Map
    Li, Tianping
    Xu, Hongxin
    Zhang, Hua
    Wan, Honglin
    [J]. JOURNAL OF SENSORS, 2021, 2021
  • [2] Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometry
    Wu, Cho-Ying
    Xu, Qiangeng
    Neumann, Ulrich
    [J]. 2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 453 - 463
  • [3] Deepfake Video Detection Using 3DMM Facial Reconstruction Information
    Hu, Yongjian
    She, Huimin
    Liu, Beibei
    Chen, Xiangquan
    Liu, Guangyao
    [J]. Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2024, 49 (02): : 190 - 196
  • [4] Colorful 3D Reconstruction from Single Image Based on Deep Learning
    Zhu Yuzheng
    Zhang Yaping
    Feng Qiaosheng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [5] 3D Face Generation From Sketch Using ASM And 3DMM
    Nomani, Heba
    Sondur, Shanta
    [J]. 2018 INTERNATIONAL CONFERENCE ON ADVANCES IN COMMUNICATION AND COMPUTING TECHNOLOGY (ICACCT), 2018, : 426 - 430
  • [6] 3D Facial Images Reconstruction from Single Facial Image
    Osawa, Shunya
    Duan, Guifang
    Seo, Masataka
    Igarashi, Takanori
    Chen, Yen-Wei
    [J]. 2012 6TH INTERNATIONAL CONFERENCE ON NEW TRENDS IN INFORMATION SCIENCE, SERVICE SCIENCE AND DATA MINING (ISSDM2012), 2012, : 487 - 490
  • [7] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    [J]. Multimedia Tools and Applications, 2021, 80 (01): : 463 - 498
  • [8] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (01) : 463 - 498
  • [9] Single image 3D object reconstruction based on deep learning: A review
    Kui Fu
    Jiansheng Peng
    Qiwen He
    Hanxiao Zhang
    [J]. Multimedia Tools and Applications, 2021, 80 : 463 - 498
  • [10] Robust and Accurate 3D Head Pose Estimation through 3DMM and Online Head Model Reconstruction
    Yu, Yu
    Mora, Kenneth Alberto Funes
    Odobez, Jean-Marc
    [J]. 2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 711 - 718