Facial Emotion Recognition Using an Ensemble of Multi-Level Convolutional Neural Networks

被引:28
|
作者
Hai-Duong Nguyen [1 ]
Yeom, Soonja [2 ]
Lee, Guee-Sang [1 ]
Yang, Hyung-Jeong [1 ]
Na, In-Seop [3 ]
Kim, Soo-Hyung [1 ]
机构
[1] Chonnam Natl Univ, Sch Elect & Comp Engn, Gwangju, South Korea
[2] Univ Tasmania, Sch Engn & ICT, Hobart, Tas, Australia
[3] Chosun Univ, Software Convergence Educ Inst, Gwangju, South Korea
基金
新加坡国家研究基金会;
关键词
Ensemble model; facial emotion recognition in the wild; FER2013; hierarchical features; multi-level convolutional neural networks;
D O I
10.1142/S0218001419400159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition plays an indispensable role in human-machine interaction system. The process includes finding interesting facial regions in images and classifying them into one of seven classes: angry, disgust, fear, happy, neutral, sad, and surprise. Although many breakthroughs have been made in image classification, especially in facial expression recognition, this research area is still challenging in terms of wild sampling environment. In this paper, we used multi-level features in a convolutional neural network for facial expression recognition. Based on our observations, we introduced various network connections to improve the classification task. By combining the proposed network connections, our method achieved competitive results compared to state-of-the-art methods on the FER2013 dataset.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Facial Expression Recognition Using a Temporal Ensemble of Multi-Level Convolutional Neural Networks
    Hai-Duong Nguyen
    Kim, Sun-Hee
    Lee, Guee-Sang
    Yang, Hyung-Jeong
    Na, In-Seop
    Kim, Soo-Hyung
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (01) : 226 - 237
  • [2] Speech Emotion Recognition based on Multi-Level Residual Convolutional Neural Networks
    Zheng, Kai
    Xia, ZhiGuang
    Zhang, Yi
    Xu, Xuan
    Fu, Yaqin
    [J]. ENGINEERING LETTERS, 2020, 28 (02) : 559 - 565
  • [3] Facial Expression Recognition Using a Multi-level Convolutional Neural Network
    Hai-Duong Nguyen
    Yeom, Soonja
    Oh, Il-Seok
    Kim, Kyoung-Min
    Kim, Soo-Hyung
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (ICPRAI 2018), 2018, : 217 - 221
  • [4] Facial Emotion Recognition using Convolutional Neural Networks
    Rzayeva, Zeynab
    Alasgarov, Emin
    [J]. 2019 IEEE 13TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT 2019), 2019, : 91 - 95
  • [5] Facial emotion recognition using convolutional neural networks
    Sarvakar, Ketan
    Senkamalavalli, R.
    Raghavendra, S.
    Santosh Kumar, J.
    Manjunath, R.
    Jaiswal, Sushma
    [J]. Materials Today: Proceedings, 2023, 80 : 3560 - 3564
  • [6] Facial emotion recognition using convolutional neural networks (FERC)
    Ninad Mehendale
    [J]. SN Applied Sciences, 2020, 2
  • [7] Facial emotion recognition using convolutional neural networks (FERC)
    Mehendale, Ninad
    [J]. SN APPLIED SCIENCES, 2020, 2 (03):
  • [8] An Ensemble Model for Multi-Level Speech Emotion Recognition
    Zheng, Chunjun
    Wang, Chunli
    Jia, Ning
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (01):
  • [9] A Multi-level Classification Approach for Facial Emotion Recognition
    Drume, Dev
    Jalal, Anand Singh
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMPUTING RESEARCH (ICCIC), 2012, : 288 - 292
  • [10] Fast Facial emotion recognition Using Convolutional Neural Networks and Gabor Filters
    Zadeh, Milad Mohammad Taghi
    Imani, Maryam
    Majidi, Babak
    [J]. 2019 IEEE 5TH CONFERENCE ON KNOWLEDGE BASED ENGINEERING AND INNOVATION (KBEI 2019), 2019, : 577 - 581