Accurate computing of facial expression recognition using a hybrid feature extraction technique

被引:12
|
作者
Kommineni, Jenni [1 ,2 ]
Mandala, Satria [3 ]
Sunar, Mohd Shahrizal [1 ,2 ]
Chakravarthy, Parvathaneni Midhu [4 ]
机构
[1] Univ Teknol Malaysia, Fac Engn & Media, Sch Comp, Johor Baharu, Malaysia
[2] Univ Teknol Malaysia, Game Innovat Ctr Excellence, Inst Human Ctr Engn, Johor Baharu, Malaysia
[3] Telkom Univ, Sch Comp, Human Centr HUMIC Engn, Bandung, Indonesia
[4] HSBC, Riyadh, Saudi Arabia
来源
JOURNAL OF SUPERCOMPUTING | 2021年 / 77卷 / 05期
关键词
Facial expression; Emotion recognition; Human– computer interaction; Dual-tree M-band wavelet transform (DTMBWT); Gaussian mixture model (GMM); Gray-level co-occurrence matrix (GLCM); TREE; DEEP;
D O I
10.1007/s11227-020-03468-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expression recognition (FER) serves as an essential tool for understanding human emotional behaviors. Facial expressions provide a wealth of information about intentions, emotions, and other inner states. Over the past two decades, the development of an automatic FER device has become one of the most demanding multimedia research areas in human-computer interaction systems. Several automatic systems have been introduced and have achieved precise identification accuracies. Due to the complex nature of the human face, however, problems still exist. Researchers are still struggling to develop effective methods for extracting features from images because of unclear features. This work proposes a methodology that improves high-performance computing in terms of the facial expression recognition accuracy. To achieve the goal of high accuracy, a hybrid method is proposed using the dual-tree m-band wavelet transform (DTMBWT) algorithm based on energy, entropy, and gray-level co-occurrence matrix (GLCM). It is accompanied by the use of a Gaussian mixture model (GMM) as the classification scheme to provide efficient identification of database images in terms of facial expressions. Using the DTMBWT, it is possible to derive many expression features from decomposition levels 1 to 6. Moreover, along with the GLCM features, the contrast and homogeneity features can be retrieved. All the features are eventually categorized and recognized with the aid of the GMM classifier. The proposed algorithms are tested using Japanese Female Facial Expression (JAFFE) database with seven different facial expressions: happiness, sadness, anger, fear, neutral, surprise, and disgust. The results of the experiments show that the highest precision of the proposed technique is 99.53%, which is observed at the 4(th) decomposition level of the DTMBWT.
引用
收藏
页码:5019 / 5044
页数:26
相关论文
共 50 条
  • [11] Feature Vector Extraction Technique for Facial Emotion Recognition Using Facial Landmarks
    Poulose, Alwin
    Kim, Jung Hwan
    Han, Dong Seog
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 1072 - 1076
  • [12] Hybrid feature extraction for facial emotion recognition
    Ali, Hasimah (hasimahali@unimap.edu.my), 1600, Inderscience Enterprises Ltd., 29, route de Pre-Bois, Case Postale 856, CH-1215 Geneva 15, CH-1215, Switzerland (13):
  • [13] Automatic facial feature extraction and facial expression recognition
    Dubuisson, S
    Davoine, F
    Cocquerez, JP
    AUDIO- AND VIDEO-BASED BIOMETRIC PERSON AUTHENTICATION, PROCEEDINGS, 2001, 2091 : 121 - 126
  • [14] Facial expression feature extraction using hybrid PCA and LBP
    LUO Yuan
    WU Cai-ming
    ZHANG Yi
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2013, 20 (02) : 120 - 124
  • [15] Facial expression feature extraction using hybrid PCA and LBP
    Luo, Yuan
    Wu, Cai-Ming
    Zhang, Yi
    Journal of China Universities of Posts and Telecommunications, 2013, 20 (02): : 120 - 124
  • [16] Spatiotemporal feature extraction for facial expression recognition
    Kamarol, Siti Khairuni Amalina
    Jaward, Mohamed Hisham
    Parkkinen, Jussi
    Parthiban, Rajendran
    IET IMAGE PROCESSING, 2016, 10 (07) : 534 - 541
  • [17] LBP feature extraction for facial expression recognition
    Liu, Weifeng
    Wang, Yanjiang
    Li, Shujuan
    Journal of Information and Computational Science, 2011, 8 (03): : 412 - 421
  • [18] Average Gabor - Wavelet Filter Feature Extraction Technique for Facial Expression Recognition
    Singh, Rohan
    Jadhav, Sanjay
    Sharma, Shweta
    Gupta, Sandeep K.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2015, 15 (05): : 102 - 104
  • [19] New Gabor-DCT Feature Extraction Technique for Facial Expression Recognition
    Dosodia, Priya
    Poonia, Amarjeet
    Gupta, Sandeep K.
    Agrwal, Shubh Lakshmi
    2015 FIFTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT2015), 2015, : 546 - 549
  • [20] Graph based feature extraction and hybrid classification approach for facial expression recognition
    Krithika, L. B.
    Priya, G. G. Lakshmi
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (02) : 2131 - 2147