Intelligent facial expression recognition and classification using optimal deep transfer learning model

被引:6
|
作者
Albraikan, Amani Abdulrahman [1 ]
Alzahrani, Jaber S. [2 ]
Alshahrani, Reem [3 ]
Yafoz, Ayman [4 ]
Alsini, Raed [4 ]
Hilal, Anwer Mustafa [5 ]
Alkhayyat, Ahmed [6 ]
Gupta, Deepak [7 ,8 ]
机构
[1] Princess Nourah bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Comp Sci, POB 84428, Riyadh 11671, Saudi Arabia
[2] Umm Al Qura Univ, Coll Engn Alqunfudah, Dept Ind Engn, Mecca, Saudi Arabia
[3] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, POB 11099, Taif 21944, Saudi Arabia
[4] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Informat Syst, Jeddah, Saudi Arabia
[5] Prince Sattam bin Abdulaziz Univ, Dept Comp & Self Dev, Preparatory Year Deanship, Alkharj, Saudi Arabia
[6] Islamic Univ, Coll Tech Engn, Najaf, Iraq
[7] Maharaja Agrasen Inst Technol, Dept Comp Sci & Engn, Delhi, India
[8] Chandigarh Univ, UCRD, Mohali, Punjab, India
关键词
Facial expression recognition; Deep learning; Mask RCNN; Face detection; Machine learning; Adam optimizer; EMOTION RECOGNITION;
D O I
10.1016/j.imavis.2022.104583
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression is commonly utilized by humans to deliver their mood and emotional state to other people. Fa-cial expression recognition (FER) becomes a hot research area in recent days, and it is a tedious process owing to the presence of high intra-class variation. The conventional methods for FEC are mainly based on handcrafted fea-tures with a classification model trained on image or video datasets. Since the facial datasets involve large vari-ations in the images and comprise partial faces, it is needed to design automated FER models. The latest advancements in artificial intelligence (AI) and deep learning (DL) models find useful for better understanding of facial emotions related to face images. In this aspect, this paper presents an intelligent FER using optimal deep transfer learning (IFER-DTFL) model. The proposed IFER-DTFL technique aims to detect the face and identify the facial expressions automatically. The IFER-DTFL technique encompasses a three state process: face detection, feature extraction, and expression classification. In addition, a mask RCNN model is used for the detection of faces. Moreover, the Adam optimizer with Densely Connected Networks (DenseNet121) model is employed for feature extraction process. Furthermore, the weighted kernel extreme learning machine (WKELM) model is utilized to classify the facial expressions. A comprehensive set of simulations were carried out on benchmark dataset and the results are inspected under varying aspects. The experimental results pointed out the supremacy of the IFER-DTFL technique over the other recent techniques interms of several performance measures.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Intelligent Deep Transfer Learning Based Malaria Parasite Detection and Classification Model Using Biomedical Image
    Alassaf, Ahmad
    Sikkandar, Mohamed Yacin
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 72 (03): : 5273 - 5285
  • [42] Deep Facial Diagnosis: Deep Transfer Learning From Face Recognition to Facial Diagnosis
    Jin, Bo
    Cruz, Leandro
    Goncalves, Nuno
    [J]. IEEE ACCESS, 2020, 8 : 123649 - 123661
  • [43] Facial Expression Recognition Using Machine Learning and Deep Learning Techniques: A Systematic Review
    Mohana M.
    Subashini P.
    [J]. SN Computer Science, 5 (4)
  • [44] Hybrid Features and Deep Learning Model for Facial Expression Recognition From Videos
    Gavade, Priyanka A.
    Bhat, Vandana S.
    Pujari, Jagadeesh
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2023, 23 (05)
  • [45] Facial Expression Recognition using Local Directional Pattern variants and Deep Learning Computer Vision and Facial Recognition
    Chengeta, Kennedy
    Viriri, Serestina
    [J]. 2018 INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND ARTIFICIAL INTELLIGENCE (ACAI 2018), 2018,
  • [46] Cross-Domain Knowledge Transfer for Incremental Deep Learning in Facial Expression Recognition
    Sugianto, Nehemia
    Tjondronegoro, Dian
    [J]. 2019 7TH INTERNATIONAL CONFERENCE ON ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS (RITA), 2019, : 205 - 209
  • [47] Cross-Domain Facial Expression Recognition Based on Transductive Deep Transfer Learning
    Yan, Keyu
    Zheng, Wenming
    Zhang, Tong
    Zong, Yuan
    Tang, Chuangao
    Lu, Cheng
    Cui, Zhen
    [J]. IEEE ACCESS, 2019, 7 : 108906 - 108915
  • [48] Deep Learning-Based Micro Facial Expression Recognition Using an Adaptive Tiefes FCNN Model
    Durga, Bandaru Kanaka
    Rajesh, Vullanki
    Jagannadham, Sirisha
    Kumar, Pattem Sampath
    Rashed, Ahmed Nabih Zaki
    Saikumar, Kayam
    [J]. TRAITEMENT DU SIGNAL, 2023, 40 (03) : 1035 - 1043
  • [49] Action unit classification for facial expression recognition using active learning and SVM
    Yao, Li
    Wan, Yan
    Ni, Hongjie
    Xu, Bugao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (16) : 24287 - 24301
  • [50] Action unit classification for facial expression recognition using active learning and SVM
    Li Yao
    Yan Wan
    Hongjie Ni
    Bugao Xu
    [J]. Multimedia Tools and Applications, 2021, 80 : 24287 - 24301