3D Facial Reconstruction from a Single Image Using a Hybrid Model Based on 3DMM and Deep Learning

被引:0
|
作者
Deshmukh, Isha [1 ]
Tripathi, Vikas [1 ]
Gangodkar, Durgaprasad [1 ]
机构
[1] Graph Era Deemed Be Univ, Dehra Dun, Uttarakhand, India
关键词
3D Facial Reconstruction; 3D Morphable Model; Face Detection; Facial Landmark Detection; Face Model Fitting; FACE RECONSTRUCTION;
D O I
10.1007/978-3-031-53830-8_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A fundamental challenge in computer vision is accurately modelling 3D faces from images. It facilitates the creation of immersive virtual experiences, realistic facial animations, and reliable identity verification. This research introduces an innovative approach aimed at reconstructing intricate facial attributes, encompassing shape, pose, and expression from a single input image. The proposed methodology employs a fusion of two potent techniques: 3D Morphable Models (3DMMs) and advanced Deep Learning (DL) methodologies. By integrating DL into tasks like face detection, expression analysis, and landmark extraction, the framework excels in reconstructing realistic facial attributes from single images even in diverse environments. The framework achieves compelling results in reconstructing "in-the-wild" faces, exhibiting notable fidelity while preserving essential facial characteristics. Experimental evaluations confirm the effectiveness and robustness of our approach, confirming its adaptability across various scenarios. Our research contributes to the advancement of 3Dface modelling techniques, addressing the challenges of accurate reconstruction and holding promise for applications in virtual reality, facial animation, medical, security, and biometrics.
引用
收藏
页码:115 / 126
页数:12
相关论文
共 50 条
  • [21] Machine learning for scene 3D reconstruction using a single image
    Knyaz, Vladimir
    [J]. OPTICS, PHOTONICS AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS VI, 2021, 11353
  • [22] Single Target SAR 3D Reconstruction Based on Deep Learning
    Wang, Shihong
    Guo, Jiayi
    Zhang, Yueting
    Hu, Yuxin
    Ding, Chibiao
    Wu, Yirong
    [J]. SENSORS, 2021, 21 (03) : 1 - 20
  • [23] The Application of 3D Morphable Model (3DMM) for Real-Time Visualization of Acupoints on a Smartphone
    Lan, Kun-Chan
    Hu, Min-Chun
    Chen, Yi-Zhang
    Zhang, Jun-Xiang
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (03) : 3289 - 3300
  • [24] 3D RECONSTRUCTION BASED ON GAT FROM A SINGLE IMAGE
    Yang Dongsheng
    Kuang Ping
    Gu Xiaofeng
    [J]. 2020 17TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2020, : 122 - 125
  • [25] 3D facial model reconstruction, expressions synthesis and animation using single frontal face image
    Patel, Narendra
    Zaveri, Mukesh
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2013, 7 (05) : 889 - 897
  • [26] 3D facial model reconstruction, expressions synthesis and animation using single frontal face image
    Narendra Patel
    Mukesh Zaveri
    [J]. Signal, Image and Video Processing, 2013, 7 : 889 - 897
  • [27] LEARNING-BASED FULLY 3D FACE RECONSTRUCTION FROM A SINGLE IMAGE
    Hu, Xiaoping
    Wang, Ying
    Zhu, Feiyun
    Pan, Chunhong
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1651 - 1655
  • [28] 3D Reconstruction from A Single Image
    Ping, Guiju
    Wang, Han
    [J]. PROCEEDINGS OF THE IEEE 2019 9TH INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS (CIS) ROBOTICS, AUTOMATION AND MECHATRONICS (RAM) (CIS & RAM 2019), 2019, : 47 - 52
  • [29] 3D Image Reconstruction Using Virtual Reality and Multimodal Deep Learning
    Chen, Yong
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2024,
  • [30] Dense 3D facial reconstruction from a single depth image in unconstrained environment
    Shu Zhang
    Hui Yu
    Ting Wang
    Lin Qi
    Junyu Dong
    Honghai Liu
    [J]. Virtual Reality, 2018, 22 : 37 - 46