Micro-expression recognition based on 3D flow convolutional neural network

被引:111
|
作者
Li, Jing [1 ]
Wang, Yandan [1 ]
See, John [2 ]
Liu, Wenbin [1 ]
机构
[1] Wenzhou Univ, Fac Comp Sci & Technol, Wenzhou 325035, Zhejiang, Peoples R China
[2] Multimedia Univ, Fac Comp & Informat, Cyberjaya 63100, Selangor, Malaysia
关键词
Facial micro-expressions; Micro-expression recognition; 3D CNN; Optical flow; CASME; SMIC;
D O I
10.1007/s10044-018-0757-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Micro-expression recognition (MER) is a growing field of research which is currently in its early stage of development. Unlike conventional macro-expressions, micro-expressions occur at a very short duration and are elicited in a spontaneous manner from emotional stimuli. While existing methods for solving MER are largely non-deep-learning-based methods, deep convolutional neural network (CNN) has shown to work very well on such as face recognition, facial expression recognition, and action recognition. In this article, we propose applying the 3D flow-based CNNs model for video-based micro-expression recognition, which extracts deeply learned features that are able to characterize fine motion flow arising from minute facial movements. Results from comprehensive experiments on three benchmark datasets-SMIC, CASME/CASME II, showed a marked improvement over state-of-the-art methods, hence proving the effectiveness of our fairly easy CNN model as the deep learning benchmark for facial MER.
引用
收藏
页码:1331 / 1339
页数:9
相关论文
共 50 条
  • [1] Micro-expression recognition based on 3D flow convolutional neural network
    Jing Li
    Yandan Wang
    John See
    Wenbin Liu
    [J]. Pattern Analysis and Applications, 2019, 22 : 1331 - 1339
  • [2] An improved micro-expression recognition algorithm of 3D convolutional neural network
    吴进
    SHI Qianwen
    XI Meng
    WANG Lei
    ZENG Huadie
    [J]. High Technology Letters, 2022, (01) : 63 - 71
  • [3] An improved micro-expression recognition algorithm of 3D convolutional neural network
    Wu J.
    Shi Q.
    Xi M.
    Wang L.
    Zeng H.
    [J]. High Technology Letters, 2022, 28 (01) : 63 - 71
  • [4] Micro-expression recognition based on multi-scale 3D residual convolutional neural network
    Jin, Hongmei
    He, Ning
    Li, Zhanli
    Yang, Pengcheng
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2024, 21 (04) : 5007 - 5031
  • [5] A Convolutional Neural Network for Compound Micro-Expression Recognition
    Zhao, Yue
    Xu, Jiancheng
    [J]. SENSORS, 2019, 19 (24)
  • [6] Deep Convolutional Neural Network with Optical Flow for Facial Micro-Expression Recognition
    Li, Qiuyu
    Yu, Jun
    Kurihara, Toru
    Zhang, Haiyan
    Zhan, Shu
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2020, 29 (01)
  • [7] Micro-Expression Recognition Algorithm Based on 3D Convolutional Neural Network and Optical Flow Fields from Neighboring Frames of Apex Frame
    Zhang, Xuesen
    Jia, Jingping
    [J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (05): : 423 - 433
  • [8] TSNN: Three-Stream Combining 2D and 3D Convolutional Neural Network for Micro-Expression Recognition
    Wu, Chao
    Guo, Fan
    [J]. IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2021, 16 (01) : 98 - 107
  • [9] Spontaneous Facial Micro-Expression Recognition using 3D Spatiotemporal Convolutional Neural Networks
    Reddy, Sai Prasanna Teja
    Karri, Surya Teja
    Dubey, Shiv Ram
    Mukherjee, Snehasis
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [10] Facial Micro-Expression Recognition Using Double-Stream 3D Convolutional Neural Network with Domain Adaptation
    Li, Zhengdao
    Zhang, Yupei
    Xing, Hanwen
    Chan, Kwok-Leung
    [J]. SENSORS, 2023, 23 (07)