Facial Emotion Recognition Using an Ensemble of Multi-Level Convolutional Neural Networks

被引:28
|
作者
Hai-Duong Nguyen [1 ]
Yeom, Soonja [2 ]
Lee, Guee-Sang [1 ]
Yang, Hyung-Jeong [1 ]
Na, In-Seop [3 ]
Kim, Soo-Hyung [1 ]
机构
[1] Chonnam Natl Univ, Sch Elect & Comp Engn, Gwangju, South Korea
[2] Univ Tasmania, Sch Engn & ICT, Hobart, Tas, Australia
[3] Chosun Univ, Software Convergence Educ Inst, Gwangju, South Korea
基金
新加坡国家研究基金会;
关键词
Ensemble model; facial emotion recognition in the wild; FER2013; hierarchical features; multi-level convolutional neural networks;
D O I
10.1142/S0218001419400159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition plays an indispensable role in human-machine interaction system. The process includes finding interesting facial regions in images and classifying them into one of seven classes: angry, disgust, fear, happy, neutral, sad, and surprise. Although many breakthroughs have been made in image classification, especially in facial expression recognition, this research area is still challenging in terms of wild sampling environment. In this paper, we used multi-level features in a convolutional neural network for facial expression recognition. Based on our observations, we introduced various network connections to improve the classification task. By combining the proposed network connections, our method achieved competitive results compared to state-of-the-art methods on the FER2013 dataset.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] A Multi-level Deep Convolutional Neural Network for Image Emotion Classification
    Wang, Weining
    Li, Lemin
    Huang, Jiexiong
    Luo, Jiebo
    Xu, Xiangmin
    [J]. Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2019, 47 (06): : 39 - 50
  • [22] Multiple Convolutional Neural Networks Fusion Using Improved Fuzzy Integral for Facial Emotion Recognition
    Lin, Cheng-Jian
    Lin, Chun-Hui
    Wang, Shyh-Hau
    Wu, Chen-Hsien
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (13):
  • [23] Feature Extraction with Handcrafted Methods and Convolutional Neural Networks for Facial Emotion Recognition
    Tsalera, Eleni
    Papadakis, Andreas
    Samarakou, Maria
    Voyiatzis, Ioannis
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (17):
  • [24] Multi-region Ensemble Convolutional Neural Network for Facial Expression Recognition
    Fan, Yingruo
    Lam, Jacqueline C. K.
    Li, Victor O. K.
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 : 84 - 94
  • [25] Automatic Concrete Damage Recognition Using Multi-Level Attention Convolutional Neural Network
    Shin, Hyun Kyu
    Ahn, Yong Han
    Lee, Sang Hyo
    Kim, Ha Young
    [J]. MATERIALS, 2020, 13 (23) : 1 - 13
  • [26] Multi-level transfer learning for improving the performance of deep neural networks: Theory and practice from the tasks of facial emotion recognition and named entity recognition
    Hung, Jason C.
    Chang, Jia-Wei
    [J]. APPLIED SOFT COMPUTING, 2021, 109
  • [27] Learning Multi-level Representations for Image Emotion Recognition in the Deep Convolutional Network
    Zhang, Hao
    Liu, Yanan
    Xu, Dan
    He, Kangjian
    Peng, Guoqin
    Yue, Yingying
    Liu, Ruhan
    [J]. THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [28] SPEECH EMOTION RECOGNITION USING QUATERNION CONVOLUTIONAL NEURAL NETWORKS
    Muppidi, Aneesh
    Radfar, Martin
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6309 - 6313
  • [29] Speech Emotion Recognition using Convolutional and Recurrent Neural Networks
    Lim, Wootaek
    Jang, Daeyoung
    Lee, Taejin
    [J]. 2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [30] Music emotion recognition using deep convolutional neural networks
    Li, Ting
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2024, 24 (4-5) : 3063 - 3078