A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network

被引:0
|
作者
Shi, Min [1 ]
Xu, Lijun [2 ]
Chen, Xiang [3 ]
机构
[1] Fuzhou Univ Int Studies & Trade, Sch Art & Design, Fuzhou 350202, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Peoples R China
[3] Jiangnan Univ, Sch Design, Wuxi 214122, Jiangsu, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Face; Face recognition; Iron; Feature extraction; Education; Games; Clustering algorithms; Facial expression recognition; convolutional neural network; fuzzy C-means clustering; support vector machine; intelligent processing; EMOTION RECOGNITION; VIDEO; PATTERN; FACE; CLASSIFICATION; REPRESENTATION; FUSION; MODEL;
D O I
10.1109/ACCESS.2020.2982286
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human facial expression is the core carrier of feedback. Facial expression recognition(FER) has been introduced into mickle fields, such as auxiliary medical care, safe driving, marketing assistance, distance education. However, in the real production process, facial expression image samples collected in different scenarios have problems such as complex backgrounds, which causes the FER model to train very slowly, low recognition rate, and insufficient generalization, so it cannot meet the actual production requirements. As the originator of the clustering algorithm, fuzzy C-means clustering(FCM) algorithm has stable performance and good results. It is applied to the convolutional layer of a convolutional neural network(CNN) to obtain a convolution kernel with an initial value, so as to extract the expression image features in the training set and the test set. This can solve the problem of random initialization of the convolution kernel. Based on the CNN, this paper introduces FCM to optimize the feature extraction (FE) capability of the model, and proposes a novel FER algorithm using an improved CNN(F-CNN). Because traditional CNN has problems such as irrational layer settings and too many parameters. The proposed F-CNN first adjusts the CNN network structure to improve the nonlinear expression ability of CNN. Then, replace the Softmax classifier that comes with CNN with a support vector machine (SVM) to improve the model & x2019;s classification ability. The comparison experiments with other models show that the improved model improve the FER rate. The introduced FCM algorithm can effectively improve the model & x2019;s FE performance and shorten the time of F-CNN during training. On the whole, F-CNN has reference value.
引用
收藏
页码:57606 / 57614
页数:9
相关论文
共 50 条
  • [1] A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network
    Shi, Min
    Xu, Lijun
    Chen, Xiang
    [J]. IEEE Access, 2020, 8 : 57606 - 57614
  • [2] Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network
    Cheng, Shuo
    Zhou, Guohui
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2020, 34 (07)
  • [3] A Novel Convolutional Neural Network for Facial Expression Recognition
    Li, Jing
    Mi, Yang
    Yu, Jiahui
    Ju, Zhaojie
    [J]. COGNITIVE SYSTEMS AND SIGNAL PROCESSING, PT II, 2019, 1006 : 310 - 320
  • [4] Facial Expression Recognition Based on Improved Convolutional Neural Network
    Siyuan L.
    Libiao W.
    Yuzhen Z.
    [J]. Journal of Engineering Science and Technology Review, 2023, 16 (01) : 61 - 67
  • [5] Facial Expression Recognition Using Convolutional Neural Network
    Gan, Yijun
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING (ICVISP 2018), 2018,
  • [6] Facial Expression Recognition using Convolutional Neural Network on Graphs
    Wu, Chenhui
    Chai, Li
    Yang, Jun
    Sheng, Yuxia
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7572 - 7576
  • [7] Emotion Recognition of Facial Expression Using Convolutional Neural Network
    Kumar, Pradip
    Kishore, Ankit
    Pandey, Raksha
    [J]. INNOVATIVE DATA COMMUNICATION TECHNOLOGIES AND APPLICATION, 2020, 46 : 362 - 369
  • [8] Deep Convolutional Neural Network for Facial Expression Recognition using Facial Parts
    Nwosu, Lucy
    Wang, Hui
    Lu, Jiang
    Unwala, Ishaq
    Yang, Xiaokun
    Zhang, Ting
    [J]. 2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 1318 - 1321
  • [9] An Intelligent Facial Expression Recognition System Using a Hybrid Deep Convolutional Neural Network for Multimedia Applications
    Obaid, Ahmed J.
    Alrammahi, Hassanain K.
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [10] Facial expression recognition method based on deep convolutional neural network combined with improved LBP features
    Fanzhi Kong
    [J]. Personal and Ubiquitous Computing, 2019, 23 : 531 - 539