Facial Emotion Recognition Using an Ensemble of Multi-Level Convolutional Neural Networks

被引:28
|
作者
Hai-Duong Nguyen [1 ]
Yeom, Soonja [2 ]
Lee, Guee-Sang [1 ]
Yang, Hyung-Jeong [1 ]
Na, In-Seop [3 ]
Kim, Soo-Hyung [1 ]
机构
[1] Chonnam Natl Univ, Sch Elect & Comp Engn, Gwangju, South Korea
[2] Univ Tasmania, Sch Engn & ICT, Hobart, Tas, Australia
[3] Chosun Univ, Software Convergence Educ Inst, Gwangju, South Korea
基金
新加坡国家研究基金会;
关键词
Ensemble model; facial emotion recognition in the wild; FER2013; hierarchical features; multi-level convolutional neural networks;
D O I
10.1142/S0218001419400159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition plays an indispensable role in human-machine interaction system. The process includes finding interesting facial regions in images and classifying them into one of seven classes: angry, disgust, fear, happy, neutral, sad, and surprise. Although many breakthroughs have been made in image classification, especially in facial expression recognition, this research area is still challenging in terms of wild sampling environment. In this paper, we used multi-level features in a convolutional neural network for facial expression recognition. Based on our observations, we introduced various network connections to improve the classification task. By combining the proposed network connections, our method achieved competitive results compared to state-of-the-art methods on the FER2013 dataset.
引用
收藏
页数:17
相关论文
共 50 条
  • [11] Facial emotion recognition based music system using convolutional neural networks
    Sana, S. K.
    Sruthi, G.
    Suresh, D.
    Rajesh, G.
    Reddy, G. V. Subba
    [J]. MATERIALS TODAY-PROCEEDINGS, 2022, 62 : 4699 - 4706
  • [12] Multi-Level Wavelet Convolutional Neural Networks
    Liu, Pengju
    Zhang, Hongzhi
    Lian, Wei
    Zuo, Wangmeng
    [J]. IEEE ACCESS, 2019, 7 : 74973 - 74985
  • [13] Facial Emotion Recognition using Deep Convolutional Networks
    Mohammadpour, Mostafa
    Khaliliardali, Hossein
    Hashemi, Seyyed Mohammad R.
    AlyanNezhadi, Mohammad M.
    [J]. 2017 IEEE 4TH INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED ENGINEERING AND INNOVATION (KBEI), 2017, : 17 - 21
  • [14] Facial emotion recognition using neural networks
    Ahmad, Faizaan
    Ahmad, Amreen
    Verma, Vijay Kumar
    [J]. JOURNAL OF INFORMATION & OPTIMIZATION SCIENCES, 2023, 44 (06): : 1115 - 1126
  • [15] Facial Emotion Recognition of Students using Convolutional Neural Network
    Lasri, Imane
    Solh, Anouar Riad
    El Belkacemi, Mourad
    [J]. 2019 THIRD INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING IN DATA SCIENCES (ICDS 2019), 2019,
  • [16] Facial Emotion Recognition Using Deep Convolutional Neural Network
    Pranav, E.
    Kamal, Suraj
    Chandran, Satheesh C.
    Supriya, M. H.
    [J]. 2020 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION SYSTEMS (ICACCS), 2020, : 317 - 320
  • [17] Facial Emotion Recognition on a Dataset Using Convolutional Neural Network
    Tumen, Vedat
    Soylemez, Omer Faruk
    Ergen, Burhan
    [J]. 2017 INTERNATIONAL ARTIFICIAL INTELLIGENCE AND DATA PROCESSING SYMPOSIUM (IDAP), 2017,
  • [18] Emotion Recognition of Facial Expression Using Convolutional Neural Network
    Kumar, Pradip
    Kishore, Ankit
    Pandey, Raksha
    [J]. INNOVATIVE DATA COMMUNICATION TECHNOLOGIES AND APPLICATION, 2020, 46 : 362 - 369
  • [19] Photo-Realistic Facial Emotion Synthesis Using Multi-level Critic Networks with Multi-level Generative Model
    Park, Minho
    Kim, Hak Gu
    Ro, Yong Man
    [J]. MULTIMEDIA MODELING, MMM 2019, PT II, 2019, 11296 : 3 - 15
  • [20] Multi-level graded facial emotion intensity recognition using MCANN for health care
    Begum, Nazmin
    Mustafa, A. Syed
    [J]. INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2023, 17 (02): : 331 - 341