Accurate computing of facial expression recognition using a hybrid feature extraction technique

被引:12
|
作者
Kommineni, Jenni [1 ,2 ]
Mandala, Satria [3 ]
Sunar, Mohd Shahrizal [1 ,2 ]
Chakravarthy, Parvathaneni Midhu [4 ]
机构
[1] Univ Teknol Malaysia, Fac Engn & Media, Sch Comp, Johor Baharu, Malaysia
[2] Univ Teknol Malaysia, Game Innovat Ctr Excellence, Inst Human Ctr Engn, Johor Baharu, Malaysia
[3] Telkom Univ, Sch Comp, Human Centr HUMIC Engn, Bandung, Indonesia
[4] HSBC, Riyadh, Saudi Arabia
来源
JOURNAL OF SUPERCOMPUTING | 2021年 / 77卷 / 05期
关键词
Facial expression; Emotion recognition; Human– computer interaction; Dual-tree M-band wavelet transform (DTMBWT); Gaussian mixture model (GMM); Gray-level co-occurrence matrix (GLCM); TREE; DEEP;
D O I
10.1007/s11227-020-03468-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expression recognition (FER) serves as an essential tool for understanding human emotional behaviors. Facial expressions provide a wealth of information about intentions, emotions, and other inner states. Over the past two decades, the development of an automatic FER device has become one of the most demanding multimedia research areas in human-computer interaction systems. Several automatic systems have been introduced and have achieved precise identification accuracies. Due to the complex nature of the human face, however, problems still exist. Researchers are still struggling to develop effective methods for extracting features from images because of unclear features. This work proposes a methodology that improves high-performance computing in terms of the facial expression recognition accuracy. To achieve the goal of high accuracy, a hybrid method is proposed using the dual-tree m-band wavelet transform (DTMBWT) algorithm based on energy, entropy, and gray-level co-occurrence matrix (GLCM). It is accompanied by the use of a Gaussian mixture model (GMM) as the classification scheme to provide efficient identification of database images in terms of facial expressions. Using the DTMBWT, it is possible to derive many expression features from decomposition levels 1 to 6. Moreover, along with the GLCM features, the contrast and homogeneity features can be retrieved. All the features are eventually categorized and recognized with the aid of the GMM classifier. The proposed algorithms are tested using Japanese Female Facial Expression (JAFFE) database with seven different facial expressions: happiness, sadness, anger, fear, neutral, surprise, and disgust. The results of the experiments show that the highest precision of the proposed technique is 99.53%, which is observed at the 4(th) decomposition level of the DTMBWT.
引用
收藏
页码:5019 / 5044
页数:26
相关论文
共 50 条
  • [31] Facial expression recognition based on selective feature extraction
    Zhou, Gengtao
    Zhan, Yongzhao
    Zhang, Jianming
    ISDA 2006: SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 2, 2006, : 412 - +
  • [32] Facial Expression Recognition using Spatial Feature Extraction and Ensemble Deep Networks
    Afshar, Elham
    Khotanlou, Hassan
    Alighardash, Elham
    2023 6TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND IMAGE ANALYSIS, IPRIA, 2023,
  • [33] Texture based feature extraction using symbol patterns for facial expression recognition
    Mukku Nisanth Kartheek
    Munaga V. N. K. Prasad
    Raju Bhukya
    Cognitive Neurodynamics, 2024, 18 : 317 - 335
  • [34] Texture based feature extraction using symbol patterns for facial expression recognition
    Kartheek, Mukku Nisanth
    Prasad, Munaga V. N. K.
    Bhukya, Raju
    COGNITIVE NEURODYNAMICS, 2024, 18 (02) : 317 - 335
  • [35] Facial expression recognition using optical flow without complex feature extraction
    Su, Mu-Chun
    Hsieh, Yi-Jwu
    Huang, De-Yuan
    WSEAS Transactions on Computers, 2007, 6 (05): : 763 - 770
  • [36] Facial Expression Recognition with Enhanced Feature Extraction using Graph Fourier Transform
    Meena, Hemant Kumar
    Sharma, Kamalesh Kumar
    Joshi, S. D.
    2017 IEEE INTERNATIONAL CONFERENCE ON POWER, CONTROL, SIGNALS AND INSTRUMENTATION ENGINEERING (ICPCSI), 2017, : 2887 - 2891
  • [37] Facial Emotion Recognition for Human-Machine Interaction using Hybrid DWT-SFET Feature Extraction Technique
    Kamal, Shoaib
    Sayeed, Farrukh
    Rafeeq, Mohammed
    Zakir, Mohammed
    2016 SECOND INTERNATIONAL CONFERENCE ON COGNITIVE COMPUTING AND INFORMATION PROCESSING (CCIP), 2016,
  • [38] Review of feature extraction methods based on facial expression recognition
    Yang, Li
    Metallurgical and Mining Industry, 2015, 7 (06): : 379 - 385
  • [39] Feature Extraction and Facial Expression Recognition Based on Bezier Curve
    Bao, Hong
    Ma, Tao
    2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (CIT), 2014, : 884 - 887
  • [40] Feature Extraction Trends for Intelligent Facial Expression Recognition: A Survey
    Khan, Sajid Ali
    Qasim, Hafiz Syed Ahmed
    Azam, Irfan
    INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2018, 42 (04): : 507 - 514