Facial Expression Recognition by Learning Spatiotemporal Features with Multi-layer Independent Subspace Analysis

被引:0
|
作者
Lin, Chenhan [1 ]
Long, Fei [1 ]
Zhan, Yongjie [1 ,2 ]
机构
[1] Xiamen Univ, Software Sch, Ctr Digital Media Comp, Xiamen 361005, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Engn, Xiamen 361005, Peoples R China
关键词
facial expression recognition; spatiotemporal feature learning; independent subspace analysis;
D O I
暂无
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
We propose to learn spatiotemporal features for video-based facial expression recognition with multi-layer independent subspace analysis (ISA) algorithm. On the first layer, a set of ISA filters are learned from small 3D patches of the video data, and then more abstract and powerful features on the second layer are learned from the feature responses of the first layer. Two public facial expression databases, extended Cohn-Kanade and MMI are used to evaluate our method. Experimental results show that the features learned by multi-layer architecture achieve better recognition performance than that of single-layer model. Furthermore, our method outperforms popular hand-crafted features, and the overall accuracy of our method is comparable to some related feature learning based methods.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Learning spatiotemporal features by using independent component analysis with application to facial expression recognition
    Long, Fei
    Wu, Tingfan
    Movellan, Javier R.
    Bartlett, Marian S.
    Littlewort, Gwen
    [J]. NEUROCOMPUTING, 2012, 93 : 126 - 132
  • [2] Independent Component Analysis of Gabor Features for Facial Expression Recognition
    Zhang Qiang
    Chen Chen
    Zhou Changjun
    Wei Xiaopeng
    [J]. ISISE 2008: INTERNATIONAL SYMPOSIUM ON INFORMATION SCIENCE AND ENGINEERING, VOL 1, 2008, : 84 - 87
  • [3] Remarks on Computational Facial Expression Recognition from HOG Features Using Quaternion Multi-layer Neural Network
    Takahashi, Kazuhiko
    Takahashi, Sae
    Cui, Yunduan
    Hashimoto, Masafumi
    [J]. ENGINEERING APPLICATIONS OF NEURAL NETWORKS (EANN 2014), 2014, 459 : 15 - 24
  • [4] Redirected transfer learning for robust multi-layer subspace learning
    Bao, Jiaqi
    Kudo, Mineichi
    Kimura, Keigo
    Sun, Lu
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (01)
  • [5] Independent subspace of dynamic Gabor features for facial expression classification
    Siritanawan, Prarinya
    Kotani, Kazunori
    Chen, Fan
    [J]. 2014 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2014, : 47 - 54
  • [6] Learning Spatiotemporal and Geometric Features with ISA for Video-Based Facial Expression Recognition
    Lin, Chenhan
    Long, Fei
    Yao, Junfeng
    Sun, Ming-Ting
    Su, Jinsong
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2017), PT III, 2017, 10636 : 435 - 444
  • [7] Reciprocal Multi-Layer Subspace Learning for Multi-View Clustering
    Li, Ruihuang
    Zhang, Changqing
    Fu, Huazhu
    Peng, Xi
    Zhou, Tianyi
    Hu, Qinghua
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8171 - 8179
  • [8] Facial Expression Recognition using Gabor filter and Multi-layer Artificial Neural Network
    Verma, Kunika
    Khunteta, Ajay
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATION, INSTRUMENTATION AND CONTROL (ICICIC), 2017,
  • [9] A Multifaceted Independent Performance Analysis of Facial Subspace Recognition Algorithms
    Bajwa, Usama Ijaz
    Taj, Imtiaz Ahmad
    Anwar, Muhammad Waqas
    Wang, Xuan
    [J]. PLOS ONE, 2013, 8 (02):
  • [10] Facial Expression Recognition Using Depth Information and Spatiotemporal Features
    Uddin, Md. Zia
    [J]. 2016 18TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATIONS TECHNOLOGY (ICACT) - INFORMATION AND COMMUNICATIONS FOR SAFE AND SECURE LIFE, 2016, : 726 - 731