Intelligent facial expression recognition and classification using optimal deep transfer learning model

被引:6
|
作者
Albraikan, Amani Abdulrahman [1 ]
Alzahrani, Jaber S. [2 ]
Alshahrani, Reem [3 ]
Yafoz, Ayman [4 ]
Alsini, Raed [4 ]
Hilal, Anwer Mustafa [5 ]
Alkhayyat, Ahmed [6 ]
Gupta, Deepak [7 ,8 ]
机构
[1] Princess Nourah bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Comp Sci, POB 84428, Riyadh 11671, Saudi Arabia
[2] Umm Al Qura Univ, Coll Engn Alqunfudah, Dept Ind Engn, Mecca, Saudi Arabia
[3] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, POB 11099, Taif 21944, Saudi Arabia
[4] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Informat Syst, Jeddah, Saudi Arabia
[5] Prince Sattam bin Abdulaziz Univ, Dept Comp & Self Dev, Preparatory Year Deanship, Alkharj, Saudi Arabia
[6] Islamic Univ, Coll Tech Engn, Najaf, Iraq
[7] Maharaja Agrasen Inst Technol, Dept Comp Sci & Engn, Delhi, India
[8] Chandigarh Univ, UCRD, Mohali, Punjab, India
关键词
Facial expression recognition; Deep learning; Mask RCNN; Face detection; Machine learning; Adam optimizer; EMOTION RECOGNITION;
D O I
10.1016/j.imavis.2022.104583
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression is commonly utilized by humans to deliver their mood and emotional state to other people. Fa-cial expression recognition (FER) becomes a hot research area in recent days, and it is a tedious process owing to the presence of high intra-class variation. The conventional methods for FEC are mainly based on handcrafted fea-tures with a classification model trained on image or video datasets. Since the facial datasets involve large vari-ations in the images and comprise partial faces, it is needed to design automated FER models. The latest advancements in artificial intelligence (AI) and deep learning (DL) models find useful for better understanding of facial emotions related to face images. In this aspect, this paper presents an intelligent FER using optimal deep transfer learning (IFER-DTFL) model. The proposed IFER-DTFL technique aims to detect the face and identify the facial expressions automatically. The IFER-DTFL technique encompasses a three state process: face detection, feature extraction, and expression classification. In addition, a mask RCNN model is used for the detection of faces. Moreover, the Adam optimizer with Densely Connected Networks (DenseNet121) model is employed for feature extraction process. Furthermore, the weighted kernel extreme learning machine (WKELM) model is utilized to classify the facial expressions. A comprehensive set of simulations were carried out on benchmark dataset and the results are inspected under varying aspects. The experimental results pointed out the supremacy of the IFER-DTFL technique over the other recent techniques interms of several performance measures.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Intelligent deep learning based ethnicity recognition and classification using facial images
    Sunitha, Gurram
    Geetha, K.
    Neelakandan, S.
    Pundir, Aditya Kumar Singh
    Hemalatha, S.
    Kumar, Vinay
    [J]. IMAGE AND VISION COMPUTING, 2022, 121
  • [2] Facial Expression Recognition Using Transfer Learning on Deep Convolutional Network
    Hablani, Ramchand
    [J]. BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2020, 13 (14): : 185 - 188
  • [3] Automated sheep facial expression classification using deep transfer learning
    Noor, Alam
    Zhao, Yaqin
    Koubaa, Anis
    Wu, Longwen
    Khan, Rahim
    Abdalla, Fakheraldin Y. O.
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 175
  • [4] Facial Expression Recognition Using Deep Learning
    Shehu, Harisu Abdullahi
    Sharif, Md Haidar
    Uyaver, Sahin
    [J]. FOURTH INTERNATIONAL CONFERENCE OF MATHEMATICAL SCIENCES (ICMS 2020), 2021, 2334
  • [5] Facial Expression Recognition using Transfer Learning
    Ramalingam, Soodamani
    Garzia, Fabio
    [J]. 2018 52ND ANNUAL IEEE INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY (ICCST), 2018, : 152 - 156
  • [6] Facial Expression Recognition and Recommendations Using Deep Neural Network with Transfer Learning
    Darapaneni, Narayana
    Choubey, Rahul
    Salvi, Pratik
    Pathak, Ankur
    Suryavanshi, Sajal
    Paduri, Anwesh Reddy
    [J]. 2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 668 - 673
  • [7] Robust Facial Expression Recognition Using an Evolutionary Algorithm with a Deep Learning Model
    Rajasimman, Mayuri Arul Vinayakam
    Manoharan, Ranjith Kumar
    Subramani, Neelakandan
    Aridoss, Manimaran
    Galety, Mohammad Gouse
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [8] Deep reinforcement learning for robust emotional classification in facial expression recognition
    Li, Huadong
    Xu, Hua
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 204
  • [9] Deep Learning Based Transfer Learning for Possible Facial Psychological Expression Recognition
    Li, Mi
    Cao, Lei
    Liu, Dachao
    Li, Leilei
    Lu, Shengfu
    [J]. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2018, 8 (07) : 1478 - 1485
  • [10] Facial Emotion Recognition Using Transfer Learning in the Deep CNN
    Akhand, M. A. H.
    Roy, Shuvendu
    Siddique, Nazmul
    Kamal, Md Abdus Samad
    Shimamura, Tetsuya
    [J]. ELECTRONICS, 2021, 10 (09)