Deep Convolutional Neural Network for Facial Expression Recognition using Facial Parts

被引:20
|
作者
Nwosu, Lucy [1 ]
Wang, Hui [1 ]
Lu, Jiang [1 ]
Unwala, Ishaq [1 ]
Yang, Xiaokun [1 ]
Zhang, Ting [2 ]
机构
[1] Univ Houston Clear Lake, Dept Comp Engn, Houston, TX 77058 USA
[2] Univ Houston Downtown, Dept CSET, Houston, TX 77002 USA
关键词
Facial expression recognition; Convolutional Neural Networks; Facial Parts;
D O I
10.1109/DASC-PICom-DataCom-CyberSciTec.2017.213
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes the design of a Facial Expression Recognition (FER) system based on deep convolutional neural network by using facial parts. In this work, a simple solution for facial expression recognition that uses a combination of algorithms for face detection, feature extraction and classification is discussed. The proposed method uses a two-channel convolutional neural network in which Facial Parts (FPs) are used as input to the first convolutional layer, the extracted eyes are used as input to the first channel while the mouth is the input into the second channel. Information from both channels converges in a fully connected layer which is used to learn global information from these local features and is then used for classification. Experiments are carried out on the Japanese Female Facial Expression (JAFFE) and the Extended Cohn-Kanada (CK+) datasets to determine the recognition accuracy for the proposed FER system. The results achieved shows that the system provides improved classification accuracy when compared to other methods.
引用
收藏
页码:1318 / 1321
页数:4
相关论文
共 50 条
  • [1] Deep Convolutional Neural Network for Facial Expression Recognition
    Zhai, Yikui
    Liu, Jian
    Zeng, Junying
    Piuri, Vincenzo
    Scotti, Fabio
    Ying, Zilu
    Xu, Ying
    Gan, Junying
    [J]. IMAGE AND GRAPHICS (ICIG 2017), PT I, 2017, 10666 : 211 - 223
  • [2] Facial Expression Recognition Using Convolutional Neural Network
    Gan, Yijun
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING (ICVISP 2018), 2018,
  • [3] Facial expression recognition based on deep convolutional neural network
    Wang, Kejun
    Chen, Jing
    Zhang, Xinyi
    Sun, Liying
    [J]. 2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 629 - 634
  • [4] Facial Emotion Recognition Using Deep Convolutional Neural Network
    Pranav, E.
    Kamal, Suraj
    Chandran, Satheesh C.
    Supriya, M. H.
    [J]. 2020 6TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION SYSTEMS (ICACCS), 2020, : 317 - 320
  • [5] Facial Expression Recognition Using Deep Convolutional Neural Networks
    Dinh Viet Sang
    Nguyen Van Dat
    Do Phan Thuan
    [J]. 2017 9TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (KSE 2017), 2017, : 130 - 135
  • [6] Facial Expression Recognition Using Deep Neural Network
    Mozaffari, Leila
    Brekke, Marte Marie
    Gajaruban, Brintha
    Purba, Dianike
    Zhang, Jianhua
    [J]. 2023 3RD INTERNATIONAL CONFERENCE ON APPLIED ARTIFICIAL INTELLIGENCE, ICAPAI, 2023, : 48 - 56
  • [7] Facial Expression Recognition using Convolutional Neural Network on Graphs
    Wu, Chenhui
    Chai, Li
    Yang, Jun
    Sheng, Yuxia
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7572 - 7576
  • [8] Emotion Recognition of Facial Expression Using Convolutional Neural Network
    Kumar, Pradip
    Kishore, Ankit
    Pandey, Raksha
    [J]. INNOVATIVE DATA COMMUNICATION TECHNOLOGIES AND APPLICATION, 2020, 46 : 362 - 369
  • [9] Real-Time Facial Expression Recognition Using Deep Convolutional Neural Network
    Zeng, Yuwen
    Xiao, Nan
    Wang, Kaidi
    Yuan, Hang
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2019, : 1536 - 1541
  • [10] Facial Expression Classification Using Deep Convolutional Neural Network
    Choi, In-kyu
    Ahn, Ha-eun
    Yoo, Jisang
    [J]. JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2018, 13 (01) : 485 - 492