Spectral Correspondence Framework for Building a 3D Baby Face Model

被引:3
|
作者
Morales, Araceli [1 ]
Porras, Antonio R. [2 ]
Tu, Liyun [2 ]
Linguraru, Marius George [2 ,3 ]
Piella, Gemma [1 ]
Sukno, Federico M. [1 ]
机构
[1] Pompeu Fabra Univ, Dept Informat & Commun Technol, Barcelona, Spain
[2] Sheikh Zayed Inst Pediat Surg Innovat, Childrens Natl Hlth Syst, Washington, DC USA
[3] George Washington Univ, Sch Med & Hlth Sci, Washington, DC 20052 USA
关键词
DYSMORPHOLOGY;
D O I
10.1109/FG47880.2020.00079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Early detection of facial dysmorphology - variations of the normal facial geometry - is essential for the timely detection of genetic conditions, which has a significant impact in the reduction of the mortality and morbidity associated with them. A model encoding the normal variability in the healthy population can serve as a reference to quantify the often subtle facial abnormalities that are present in young patients with such conditions. In this paper, we present the first facial model constructed exclusively from newborn data, the Baby Face Model (BabyFM). Our model is built from 3D scans with an innovative pipeline based on least squared conformal maps (LSCM). LSCM are piece-wise linear mappings that project the training faces to a common 2D space minimising the conformal distortion. This process allows improving the correspondences between 3D faces, which is particularly important for the identification of subtle dysmorphology. We evaluate the ability of our BabyFM to recover the babys facial morphology from a set of 2D images by comparing it to state-of-the-art facial models. We also compare it to models built following an analogous pipeline to the one proposed in this paper but using nonrigid iterative closest point (NICP) to establish dense correspondences between the training faces. The results show that our model reconstructs the facial morphology of babies with significantly smaller errors than the state-of-the-art models (p < 10(-4)) and the "NICP models" (p < 0.01).
引用
收藏
页码:708 / 715
页数:8
相关论文
共 50 条
  • [1] Evaluation of 3D correspondence methods for model building
    Styner, MA
    Rajamani, KT
    Nolte, LP
    Zsemlye, G
    Székely, G
    Taylor, CJ
    Davies, RH
    INFORMATION PROCESSING IN MEDICAL IMAGING, PROCEEDINGS, 2003, 2732 : 63 - 75
  • [2] Dense 3D Face Correspondence
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    Shafait, Faisal
    Reid, Ian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (07) : 1584 - 1598
  • [3] An automatic method of building 3D morohable face model
    Guo, H
    Liu, CM
    Zhang, LM
    ADVANCES IN BIOMETRIC PERSON AUTHENTICATION, PROCEEDINGS, 2005, 3781 : 50 - 58
  • [4] A 3D face matching framework
    ter Haar, Frank B.
    Veltkamp, Remco C.
    IEEE INTERNATIONAL CONFERENCE ON SHAPE MODELING AND APPLICATIONS 2008, PROCEEDINGS, 2008, : 103 - 110
  • [5] A CASCADED FRAMEWORK FOR MODEL-BASED 3D FACE RECONSTRUCTION
    Wang, Pengrui
    Che, Wujun
    Xu, Bo
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 3151 - 3155
  • [6] 3D shape isometric correspondence by spectral assignment
    Pan, Xiang
    Shapiro, Linda
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 2210 - 2213
  • [7] Robust 3D shape correspondence in the spectral domain
    Jain, Varun
    Zhang, Hao
    IEEE INTERNATIONAL CONFERENCE ON SHAPE MODELING AND APPLICATIONS 2006, PROCEEDINGS, 2006, : 118 - +
  • [8] Building a 3D morphable face model by using thin plate splines for face reconstruction
    Guo, H
    Jiang, JY
    Zhang, LM
    ADVANCES IN BIOMETRIC PERSON AUTHENTICATION, PROCEEDINGS, 2004, 3338 : 258 - 267
  • [9] 3D model building
    Ho, YK
    Chua, CS
    SEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ITS APPLICATIONS, 1999, (465): : 270 - 274
  • [10] A Face Fairness Framework for 3D Meshes
    Sk. Mohammadul Haque
    Venu Madhav Govindu
    International Journal of Computer Vision, 2020, 128 : 1565 - 1579