3D facial expression modeling based on facial landmarks in single image

被引:13
|
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [1] Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis
    Huang, Yanhui
    Zhang, Xing
    Fan, Yangyu
    Yin, Lijun
    Seversky, Lee
    Allen, James
    Lei, Tao
    Dong, Weijun
    [J]. IMAGE AND VISION COMPUTING, 2012, 30 (10) : 750 - 761
  • [2] 3D Facial Images Reconstruction from Single Facial Image
    Osawa, Shunya
    Duan, Guifang
    Seo, Masataka
    Igarashi, Takanori
    Chen, Yen-Wei
    [J]. 2012 6TH INTERNATIONAL CONFERENCE ON NEW TRENDS IN INFORMATION SCIENCE, SERVICE SCIENCE AND DATA MINING (ISSDM2012), 2012, : 487 - 490
  • [3] 3D facial expression modeling for recognition
    Lu, XG
    Jain, AK
    Dass, S
    [J]. BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION II, 2005, 5779 : 113 - 121
  • [4] Image-based fast 3D individual facial modeling
    Zhang, Mandun
    Li, Zhi
    Wu, Hongtao
    Yu, Ming
    [J]. PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS, 2007, : 868 - +
  • [5] Facial Expression Study Based on 3D Facial Emotion Recognition
    Cao, HongYuan
    Qi, Chao
    [J]. 20TH INT CONF ON UBIQUITOUS COMP AND COMMUNICAT (IUCC) / 20TH INT CONF ON COMP AND INFORMATION TECHNOLOGY (CIT) / 4TH INT CONF ON DATA SCIENCE AND COMPUTATIONAL INTELLIGENCE (DSCI) / 11TH INT CONF ON SMART COMPUTING, NETWORKING, AND SERV (SMARTCNS), 2021, : 375 - 381
  • [6] Remote Heart Rate Estimation Based on 3D Facial Landmarks
    Maki, Yuichiro
    Monno, Yusuke
    Tanaka, Masayuki
    Okutomi, Masatoshi
    [J]. 42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 2634 - 2637
  • [7] Reproducibility of facial soft tissue landmarks on facial images captured on a 3D camera
    Othman, Siti Adibah
    Ahmad, Roshahida
    Merican, Amir Feisal
    Jamaludin, Marhazlinda
    [J]. AUSTRALIAN ORTHODONTIC JOURNAL, 2013, 29 (01) : 58 - 65
  • [8] A 3D Statistical Facial Feature Model and Its Application on Locating Facial Landmarks
    Zhao, Xi
    Dellandrea, Emmanuel
    Chen, Liming
    [J]. ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PROCEEDINGS, 2009, 5807 : 686 - 697
  • [9] LANDMARK IDENTIFICATION IN 3D IMAGE FOR FACIAL EXPRESSION RECOGNITION
    Sindhuja, C.
    Mala, K.
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATIONS TECHNOLOGIES (ICCCT 15), 2015, : 338 - 343
  • [10] Reproducibility of facial soft tissue landmarks on facial images captured on a 3D camera
    Othman, Siti Adibah
    Ahmad, Roshahida
    Merican, Amir Feisal
    Jamaludin, Marhazlinda
    [J]. AUSTRALASIAN ORTHODONTIC JOURNAL, 2013, 29 (01): : 58 - 65