3D Facial Reconstruction from a Single Image Using a Hybrid Model Based on 3DMM and Deep Learning

被引:0
|
作者
Deshmukh, Isha [1 ]
Tripathi, Vikas [1 ]
Gangodkar, Durgaprasad [1 ]
机构
[1] Graph Era Deemed Be Univ, Dehra Dun, Uttarakhand, India
关键词
3D Facial Reconstruction; 3D Morphable Model; Face Detection; Facial Landmark Detection; Face Model Fitting; FACE RECONSTRUCTION;
D O I
10.1007/978-3-031-53830-8_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A fundamental challenge in computer vision is accurately modelling 3D faces from images. It facilitates the creation of immersive virtual experiences, realistic facial animations, and reliable identity verification. This research introduces an innovative approach aimed at reconstructing intricate facial attributes, encompassing shape, pose, and expression from a single input image. The proposed methodology employs a fusion of two potent techniques: 3D Morphable Models (3DMMs) and advanced Deep Learning (DL) methodologies. By integrating DL into tasks like face detection, expression analysis, and landmark extraction, the framework excels in reconstructing realistic facial attributes from single images even in diverse environments. The framework achieves compelling results in reconstructing "in-the-wild" faces, exhibiting notable fidelity while preserving essential facial characteristics. Experimental evaluations confirm the effectiveness and robustness of our approach, confirming its adaptability across various scenarios. Our research contributes to the advancement of 3Dface modelling techniques, addressing the challenges of accurate reconstruction and holding promise for applications in virtual reality, facial animation, medical, security, and biometrics.
引用
收藏
页码:115 / 126
页数:12
相关论文
共 50 条
  • [41] Research on 3D Reconstruction Based on a Single Image
    Yu Yong-yan
    Wang Zhi-jian
    [J]. PROGRESS IN MEASUREMENT AND TESTING, PTS 1 AND 2, 2010, 108-111 : 3 - 10
  • [42] Deep Learning-based 3D Image Generation Using a Single 2D Projection Image
    Lei, Yang
    Tian, Zhen
    Wang, Tonghe
    Roper, Justin
    Higgins, Kristin
    Bradley, Jeffrey D.
    Curran, Walter J.
    Liu, Tian
    Yang, Xiaofeng
    [J]. MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596
  • [43] Hybrid-supervised deep learning for domain transfer 3D protoacoustic image reconstruction
    Lang, Yankun
    Jiang, Zhuoran
    Sun, Leshan
    Xiang, Liangzhong
    Ren, Lei
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (08):
  • [44] Nonrigid 3D Reconstruction from a Single Image
    Ma, Wen-juan
    [J]. 2016 INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI 2016), 2016, : 138 - 142
  • [45] FACES: 3D FAcial reConstruction from anciEnt Skulls using content based image retrieval
    Abate, AF
    Nappi, M
    Ricciardi, S
    Tortora, G
    [J]. JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2004, 15 (05): : 373 - 389
  • [46] A FAST 3D FACE RECONSTRUCTION METHOD FROM A SINGLE IMAGE USING ADJUSTABLE MODEL
    Wu, Tao
    Zhou, Fei
    Liao, Qingmin
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1656 - 1660
  • [47] 3D Map Reconstruction From Single Satellite Image Using a Deep Monocular Depth Network
    Son, Changmin
    Park, Soon-Yong
    [J]. 2022 THIRTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN), 2022, : 5 - 7
  • [48] Face It: 3D Facial Reconstruction from a Single 2D Image for Games and Simulations
    Kirtzic, J. Steven
    Daescu, Ovidiu
    [J]. 2011 INTERNATIONAL CONFERENCE ON CYBERWORLDS, 2011, : 244 - 248
  • [49] Reconstruction of 3D face model from single shading image based on anatomical database
    Yoshiki, Kaori
    Saito, Hideo
    Mochimaru, Masaaki
    [J]. 18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS, 2006, : 350 - +
  • [50] A LINEARIZATION-BASED HYBRID APPROACH FOR 3D RECONSTRUCTION OF OBJECTS IN A SINGLE IMAGE
    Kotan, Muhammed
    Oz, Cemil
    Kahraman, Abdulgani
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2021, 31 (03) : 501 - 513