Convolutional Neural Network-Bidirectional Gated Recurrent Unit Facial Expression Recognition Method Fused with Attention Mechanism

被引:4
|
作者
Tang, Chaolin [1 ]
Zhang, Dong [2 ]
Tian, Qichuan [1 ,3 ]
机构
[1] Beijing Univ Civil Engn & Architecture, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
[3] Beijing Key Lab Robot B & Funct Res, Beijing 100044, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 22期
关键词
facial expression recognition; attention mechanism; sliding window; Bi-GRU; EMOTION RECOGNITION; MODEL;
D O I
10.3390/app132212418
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The relationships among different subregions in facial images and their varying contributions to facial expression recognition indicate that using a fixed subregion weighting scheme would result in a substantial loss of valuable information. To address this issue, we propose a facial expression recognition network called BGA-Net, which combines bidirectional gated recurrent units (BiGRUs) with an attention mechanism. Firstly, a convolutional neural network (CNN) is employed to extract feature maps from facial images. Then, a sliding window cropping strategy is applied to divide the feature maps into multiple subregions. The BiGRUs are utilized to capture the dependencies among these subregions. Finally, an attention mechanism is employed to adaptively focus on the most discriminative regions. When evaluated on CK+, FER2013, and JAFFE datasets, our proposed method achieves promising results.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Vehicle speed prediction using a convolutional neural network combined with a gated recurrent unit with attention
    Zhang, Dongxue
    Wang, Zhennan
    Jiao, Xiaohong
    Zhang, Zhao
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024,
  • [22] Hybrid Convolutional and Gated Recurrent Unit Network with Attention for Drilling KickPrediction
    Qiao, Ying
    Tu, Xiaoyue
    Zhou, Liangzhi
    Guo, Xiao
    SPE JOURNAL, 2024, 29 (12): : 6852 - 6868
  • [23] Uncertain and biased facial expression recognition based on depthwise separable convolutional neural network with embedded attention mechanism
    Shi, Piao
    Hu, Min
    Ren, Fuji
    Shi, Xuefeng
    Li, Hongbo
    Li, Zezhong
    Lin, Hui
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [24] A novel convolutional neural network with gated recurrent unit for automated speech emotion recognition and classification
    Prakash, P. Ravi
    Anuradha, D.
    Iqbal, Javid
    Galety, Mohammad Gouse
    Singh, Ruby
    Neelakandan, S.
    JOURNAL OF CONTROL AND DECISION, 2023, 10 (01) : 54 - 63
  • [25] Facial Expression Recognition Based on Multi-scale Feature Fusion Convolutional Neural Network and Attention Mechanism
    Wu, Yana
    Jia, Kebin
    Sun, Zhonghua
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 324 - 335
  • [26] Lightweight attention convolutional neural network through network slimming for robust facial expression recognition
    Hui Ma
    Turgay Celik
    Heng-Chao Li
    Signal, Image and Video Processing, 2021, 15 : 1507 - 1515
  • [27] Deep Learning Wind Power Prediction Model Based on Attention Mechanism-Based Convolutional Neural Network and Gated Recurrent Unit Neural Network
    Hou, Zai-Hong
    Bai, Yu-Long
    Ding, Lin
    Yue, Xiao-Xin
    Huang, Yu-Ting
    Song, Wei
    Bi, Qi
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2024, 33 (16)
  • [28] Lightweight attention convolutional neural network through network slimming for robust facial expression recognition
    Ma, Hui
    Celik, Turgay
    Li, Heng-Chao
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (07) : 1507 - 1515
  • [29] Facial Expression Recognition Using Multi-Branch Attention Convolutional Neural Network
    He, Yinggang
    IEEE ACCESS, 2023, 11 : 1244 - 1253
  • [30] A hybrid network based on multi-scale convolutional neural network and bidirectional gated recurrent unit for EEG denoising
    Li, Qiang
    Zhou, Yan
    Ren, Junxiao
    Wu, Qiao
    Zhao, Ji
    NEUROSCIENCE, 2025, 572 : 155 - 170