Facial Expression Recognition With Multiscale Graph Convolutional Networks

被引:11
|
作者
Rao, Tianrong [1 ]
Li, Jie [1 ]
Wang, Xiaoyu [1 ]
Sun, Yibo [1 ]
Chen, Hong [1 ]
机构
[1] China Mobile Res Inst, Beijing 248889, Peoples R China
关键词
Face recognition; Feature extraction; Emotion recognition; Image recognition; Shape; Data mining; Convolutional neural networks;
D O I
10.1109/MMUL.2021.3065985
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Recognizing emotion through facial expression has now been widely applied in our daily lives. Therefore, facial expression recognition (FER) is attracting increasing research interests in the field of artificial intelligence and multimedia. With the development of convolutional neural networks (CNN), end-to-end deep learning frameworks for FER have achieved great success on large-scale datasets. However, these works still face the problems of redundant information and data bias, which obviously decrease the performance of FER. In this article, we propose a novel multiscale graph convolutional network (GCN) based on landmark graphs extracted from facial images. The proposed method is evaluated on different popular datasets. The results show that the proposed method outperforms the traditional deep learning frameworks and achieves more stable performance on different datasets.
引用
收藏
页码:11 / 19
页数:9
相关论文
共 50 条
  • [1] Facial Expression Recognition based on Graph Convolutional Networks with Phase Congruency
    Yang, Kunlin
    Tang, Hui
    Chai, Li
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1431 - 1436
  • [2] Exploiting Emotional Dependencies with Graph Convolutional Networks for Facial Expression Recognition
    Antoniadis, Panagiotis
    Filntisis, Panagiotis Paraskevas
    Maragos, Petros
    [J]. 2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [3] Facial expression and action unit recognition augmented by their dependencies on graph convolutional networks
    He, Jun
    Yu, Xiaocui
    Sun, Bo
    Yu, Lejun
    [J]. JOURNAL ON MULTIMODAL USER INTERFACES, 2021, 15 (04) : 429 - 440
  • [4] Facial expression and action unit recognition augmented by their dependencies on graph convolutional networks
    Jun He
    Xiaocui Yu
    Bo Sun
    Lejun Yu
    [J]. Journal on Multimodal User Interfaces, 2021, 15 : 429 - 440
  • [5] Video-based Facial Expression Recognition using Graph Convolutional Networks
    Liu, Daizong
    Zhang, Hongting
    Zhou, Pan
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 607 - 614
  • [6] Facial Expression Recognition with Convolutional Neural Networks
    Singh, Shekhar
    Nasoz, Fatma
    [J]. 2020 10TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2020, : 324 - 328
  • [7] Geometry-Aware Facial Expression Recognition via Attentive Graph Convolutional Networks
    Zhao, Rui
    Liu, Tianshan
    Huang, Zixun
    Lun, Daniel P. K.
    Lam, Kin-Man
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (02) : 1159 - 1174
  • [8] Facial Attribute Recognition With Feature Decouping and Graph Convolutional Networks
    Nian, Fudong
    Chen, Xia
    Yang, Shimeng
    Lv, Gang
    [J]. IEEE ACCESS, 2019, 7 : 85500 - 85512
  • [9] GCANet: Geometry cues-aware facial expression recognition based on graph convolutional networks
    Wang, Shutong
    Zhao, Anran
    Lai, Chenghang
    Zhang, Qi
    Li, Duantengchuan
    Gao, Yihua
    Dong, Liangshan
    Wang, Xiaoguang
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (07)
  • [10] Convolutional Neural Networks Models for Facial Expression Recognition
    Ramdhani, Burhanudin
    Djamal, Esmeralda C.
    Ilyas, Ridwan
    [J]. 2018 INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT INFORMATICS (SAIN), 2018, : 96 - 101