A Novel Facial Expression Intelligent Recognition Method Using Improved Convolutional Neural Network

被引:0
|
作者
Shi, Min [1 ]
Xu, Lijun [2 ]
Chen, Xiang [3 ]
机构
[1] Fuzhou Univ Int Studies & Trade, Sch Art & Design, Fuzhou 350202, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Peoples R China
[3] Jiangnan Univ, Sch Design, Wuxi 214122, Jiangsu, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Face; Face recognition; Iron; Feature extraction; Education; Games; Clustering algorithms; Facial expression recognition; convolutional neural network; fuzzy C-means clustering; support vector machine; intelligent processing; EMOTION RECOGNITION; VIDEO; PATTERN; FACE; CLASSIFICATION; REPRESENTATION; FUSION; MODEL;
D O I
10.1109/ACCESS.2020.2982286
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human facial expression is the core carrier of feedback. Facial expression recognition(FER) has been introduced into mickle fields, such as auxiliary medical care, safe driving, marketing assistance, distance education. However, in the real production process, facial expression image samples collected in different scenarios have problems such as complex backgrounds, which causes the FER model to train very slowly, low recognition rate, and insufficient generalization, so it cannot meet the actual production requirements. As the originator of the clustering algorithm, fuzzy C-means clustering(FCM) algorithm has stable performance and good results. It is applied to the convolutional layer of a convolutional neural network(CNN) to obtain a convolution kernel with an initial value, so as to extract the expression image features in the training set and the test set. This can solve the problem of random initialization of the convolution kernel. Based on the CNN, this paper introduces FCM to optimize the feature extraction (FE) capability of the model, and proposes a novel FER algorithm using an improved CNN(F-CNN). Because traditional CNN has problems such as irrational layer settings and too many parameters. The proposed F-CNN first adjusts the CNN network structure to improve the nonlinear expression ability of CNN. Then, replace the Softmax classifier that comes with CNN with a support vector machine (SVM) to improve the model & x2019;s classification ability. The comparison experiments with other models show that the improved model improve the FER rate. The introduced FCM algorithm can effectively improve the model & x2019;s FE performance and shorten the time of F-CNN during training. On the whole, F-CNN has reference value.
引用
收藏
页码:57606 / 57614
页数:9
相关论文
共 50 条
  • [41] Facial expression recognition based on improved depthwise separable convolutional network
    Huo, Hua
    Yu, YaLi
    Liu, ZhongHua
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (12) : 18635 - 18652
  • [42] Facial expression recognition based on improved depthwise separable convolutional network
    Hua Huo
    YaLi Yu
    ZhongHua Liu
    [J]. Multimedia Tools and Applications, 2023, 82 : 18635 - 18652
  • [43] Advertisement System Based on Facial Expression Recognition and Convolutional Neural Network
    Truong Quang Vinh
    Phan Tran Dac Thinh
    [J]. ISCIT 2019: PROCEEDINGS OF 2019 19TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2019, : 476 - 480
  • [44] Facial Expression Recognition with Small Samples Under Convolutional Neural Network
    Heilongjiang College of Business and Technology, Harbin, China
    不详
    [J]. Lect. Notes Inst. Comput. Sci. Soc. Informatics Telecommun. Eng., (383-396):
  • [45] Face Expression Recognition Based on Improved Convolutional Neural Network
    Liu, Quanming
    Zhang, Jing
    Xin, Yangyang
    [J]. 2019 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND PATTERN RECOGNITION (AIPR 2019), 2019, : 61 - 65
  • [46] A Facial Expression Recognition Method Based on a Multibranch Cross-Connection Convolutional Neural Network
    Shi, Cuiping
    Tan, Cong
    Wang, Liguo
    [J]. IEEE ACCESS, 2021, 9 : 39255 - 39274
  • [47] Three convolutional neural network models for facial expression recognition in the wild
    Shao, Jie
    Qian, Yongsheng
    [J]. NEUROCOMPUTING, 2019, 355 : 82 - 92
  • [48] Comparison of Convolutional Neural Network Performances in Pain Facial Expression Recognition
    Lima, Leonardo
    Santos, Pedro
    Ribeiro, Bruno
    Magalhaes, Wallace
    Serrao, Mikaela Kalline M.
    Costa, Marly. G. F.
    Costa Filho, Cicero F. F.
    [J]. 2023 19TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, SIPAIM, 2023,
  • [49] Identity-Aware Convolutional Neural Network for Facial Expression Recognition
    Meng, Zibo
    Liu, Ping
    Cai, Jie
    Han, Shizhong
    Tong, Yan
    [J]. 2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 558 - 565
  • [50] Facial Expression Recognition Based on Random Forest and Convolutional Neural Network
    Wang, Yingying
    Li, Yibin
    Song, Yong
    Rong, Xuewen
    [J]. INFORMATION, 2019, 10 (12)