3D facial expression modeling based on facial landmarks in single image

被引:13
|
作者
Lv, Chenlei [1 ,2 ]
Wu, Zhongke [1 ,2 ]
Wang, Xingce [1 ,2 ]
Zhou, Mingquan [1 ,2 ]
机构
[1] Beijing Normal Univ, Coll Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Normal Univ, Beijing Key Lab Digital Preservat & Virtual Real, Minist Educ, Engn Res Ctr Virtual Real & Applicat, Beijing 100875, Peoples R China
基金
北京市自然科学基金; 国家重点研发计划;
关键词
Facial expression modeling; Kendall shape space; Head poses; FACE; RECOGNITION;
D O I
10.1016/j.neucom.2019.04.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression modeling is important for many applications such as human emotional analysis and facial animation. Generally, facial expression modeling from single 2D facial image is difficult. Different head poses and scales of facial data in images affect the accuracy of the modeling results. We propose a new 3D facial expression modeling method which is based on facial landmarks from single image. Using the facial landmarks, expression modeling can be processed in Kendall shape space. The Kendall shape space is mathematic space, the facial expression modeling process in Kendall shape space can be regarded as a geodesic path search between different faces. The modeling result is more accurate. The 3D facial expression modeling result is convenient to obtain from 2D facial image with different head poses. In experiments, we show the 3D facial expression modeling performance by our method, which include expression editing and evaluation in public facial database: JAFFE, LFW, Helen and RAF-DB. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 167
页数:13
相关论文
共 50 条
  • [21] Modeling and animation of individualized faces for 3D facial expression synthesis
    Zhang, Y
    Prakash, EC
    Sung, E
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2003, 13 (01) : 42 - 64
  • [22] Hierarchical face modeling and fast 3D facial expression synthesis
    Zhang, Y
    Prakash, EC
    Sung, E
    [J]. SIBGRAPI 2002: XV BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2002, : 357 - 364
  • [23] Shape-based Automatic Detection of a Large Number of 3D Facial Landmarks
    Gilani, Syed Zulqarnain
    Shafait, Faisal
    Mian, Ajmal
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 4639 - 4648
  • [24] Facial expression recognition using 3D facial feature distances
    Soyel, Hamit
    Demirel, Hasan
    [J]. IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2007, 4633 : 831 - 838
  • [25] 3D Facial Expression Recognition with Geometrically Localized Facial Features
    Soyel, Hamit
    Demirel, Hasan
    [J]. 23RD INTERNATIONAL SYMPOSIUM ON COMPUTER AND INFORMATION SCIENCES, 2008, : 229 - 232
  • [26] Generation of 3D facial expressions using 2D facial image
    Lee, HC
    Kim, ES
    Hur, GT
    Choi, HY
    [J]. Fourth Annual ACIS International Conference on Computer and Information Science, Proceedings, 2005, : 228 - 232
  • [27] 3D FACIAL EXPRESSION GENERATOR BASED ON TRANSFORMER VAE
    Zou, Kaifeng
    Yu, Boyang
    Seo, Hyewon
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2550 - 2554
  • [28] Deformation-Based 3D Facial Expression Representation
    Demisse, Girum G.
    Aouada, Djamila
    Ottersten, Bjorn
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2018, 14 (01)
  • [29] A PDA based personalized 3D facial expression system
    Chin, Seongah
    Park, Jongkyeong
    [J]. COMPUTATIONAL INTELLIGENCE, PT 2, PROCEEDINGS, 2006, 4114 : 468 - 475
  • [30] 3D Facial Expression Recognition Based on Variation Faces
    Li, Xiaoli
    Ruan, Qiuqi
    An, Gaoyun
    Ruan, Chengxiong
    [J]. PROCEEDINGS OF 2012 IEEE 11TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP) VOLS 1-3, 2012, : 775 - +