Spectral Correspondence Framework for Building a 3D Baby Face Model

被引:3
|
作者
Morales, Araceli [1 ]
Porras, Antonio R. [2 ]
Tu, Liyun [2 ]
Linguraru, Marius George [2 ,3 ]
Piella, Gemma [1 ]
Sukno, Federico M. [1 ]
机构
[1] Pompeu Fabra Univ, Dept Informat & Commun Technol, Barcelona, Spain
[2] Sheikh Zayed Inst Pediat Surg Innovat, Childrens Natl Hlth Syst, Washington, DC USA
[3] George Washington Univ, Sch Med & Hlth Sci, Washington, DC 20052 USA
关键词
DYSMORPHOLOGY;
D O I
10.1109/FG47880.2020.00079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Early detection of facial dysmorphology - variations of the normal facial geometry - is essential for the timely detection of genetic conditions, which has a significant impact in the reduction of the mortality and morbidity associated with them. A model encoding the normal variability in the healthy population can serve as a reference to quantify the often subtle facial abnormalities that are present in young patients with such conditions. In this paper, we present the first facial model constructed exclusively from newborn data, the Baby Face Model (BabyFM). Our model is built from 3D scans with an innovative pipeline based on least squared conformal maps (LSCM). LSCM are piece-wise linear mappings that project the training faces to a common 2D space minimising the conformal distortion. This process allows improving the correspondences between 3D faces, which is particularly important for the identification of subtle dysmorphology. We evaluate the ability of our BabyFM to recover the babys facial morphology from a set of 2D images by comparing it to state-of-the-art facial models. We also compare it to models built following an analogous pipeline to the one proposed in this paper but using nonrigid iterative closest point (NICP) to establish dense correspondences between the training faces. The results show that our model reconstructs the facial morphology of babies with significantly smaller errors than the state-of-the-art models (p < 10(-4)) and the "NICP models" (p < 0.01).
引用
收藏
页码:708 / 715
页数:8
相关论文
共 50 条
  • [21] A 3D face matching framework for facial curves
    ter Haar, Frank B.
    Veltkamp, Remco C.
    GRAPHICAL MODELS, 2009, 71 (1-6) : 77 - 91
  • [22] An LBP representation framework for 3D face recognition
    Tang, Hengliang
    Sun, Yanfeng
    Yin, Baocai
    Ge, Yun
    Journal of Information and Computational Science, 2010, 7 (09): : 1905 - 1914
  • [23] A Framework for Virtual 3D Manipulation of Face in Video
    Park, Jungsik
    Park, Jong-Il
    25TH 2018 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2018, : 649 - 650
  • [24] Boosting Local Shape Matching for Dense 3D Face Correspondence
    Fan, Zhenfeng
    Hu, Xiyuan
    Chen, Chen
    Peng, Silong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10936 - 10946
  • [25] A Face Replacement System Based on 3D Face Model
    Song, Hong
    Lv, Jie
    Liu, He
    Zhao, Qingjie
    PROCEEDINGS OF THE 2015 CHINESE INTELLIGENT AUTOMATION CONFERENCE: INTELLIGENT INFORMATION PROCESSING, 2015, 336 : 237 - 246
  • [26] Orientation-Preserving Spectral Correspondence for 3D Shape Analysis
    Han, Li
    Liu, Shuning
    Yu, Bing
    Xu, Shengsi
    Xiang, Rui
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2020, 64 (01)
  • [27] Nonlinear 3D Face Morphable Model
    Luan Tran
    Liu, Xiaoming
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7346 - 7355
  • [28] 3D model enhanced face recognition
    Zhao, WY
    Chellappa, R
    2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2000, : 50 - 53
  • [29] 3D Face Model Fitting for Recognition
    ter Haar, Frank B.
    Veltkamp, Renico C.
    COMPUTER VISION - ECCV 2008, PT IV, PROCEEDINGS, 2008, 5305 : 652 - 664
  • [30] FACE IMAGE ENHANCEMENT USING 3D AND SPECTRAL INFORMATION
    Dubout, Charles
    Tsukada, Masato
    Ishiyama, Rui
    Funayama, Chisato
    Suesstrunk, Sabine
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 697 - +