A Novel Transformer-Based Approach for Adult's Facial Emotion Recognition

被引:0
|
作者
Nawaz, Uzma [1 ]
Saeed, Zubair [2 ,3 ]
Atif, Kamran [4 ]
机构
[1] Natl Univ Sci & Technol, Coll Elect & Mech Engn, Knowledge & Data Sci Res Ctr, Dept Comp & Software Engn, Islamabad 44000, Pakistan
[2] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX 77840 USA
[3] Texas A&M Univ Qatar, Dept Elect & Comp Engn, Doha, Qatar
[4] Deakin Univ, Dept Civil Engn, Melbourne, Vic 3125, Australia
来源
IEEE ACCESS | 2025年 / 13卷
关键词
Emotion recognition; Transformers; Face recognition; Accuracy; Brain modeling; Real-time systems; Adaptation models; Lighting; Human computer interaction; Facial features; Facial emotion recognition; transformers; deep learning; FER2013; CK plus; AffectNet; AFEW; RAF-DB; emotion recognition; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3555510
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Adult facial expression recognition (FER) is essential for human-computer interaction, mental health assessment, and social robotics applications because it improves user experiences and emotional well-being. This study presents a novel attention mechanism-based transformer approach designed to capture detailed patterns in facial features and dynamically focus on the most relevant regions for enhanced accuracy. Unlike conventional deep learning approaches, our method integrates an adaptive attention mechanism and dynamic token pruning, which optimizes computational efficiency while maintaining high accuracy. The model is evaluated on five widely used datasets: FER2013, CK+, AffectNet, RAF-DB, and AFEW. It achieves state-of-the-art performance, with accuracies of 98.67% on FER2013, 99.52% on CK+, 99.3% on AffectNet, 96.3% on AFEW, and 98.45% on RAF-DB. An ablation study further validates the contribution of each model component, and comparisons with CNN-based and transformer-based approaches confirm the effectiveness of the model. These findings establish the proposed method as a significant advancement in FER, which offers a scalable and efficient solution for real-world applications.
引用
收藏
页码:56485 / 56508
页数:24
相关论文
共 50 条
  • [1] The MERSA Dataset and a Transformer-Based Approach for Speech Emotion Recognition
    Zhang, Enshi
    Trujillo, Rafael
    Poellabauer, Christian
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 13960 - 13970
  • [2] MusicEmo: transformer-based intelligent approach towards music emotion generation and recognition
    Xin Y.
    Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (08) : 3107 - 3117
  • [3] Exploring Wearable Emotion Recognition with Transformer-Based Continual Learning
    Rizza, Federica
    Bellitto, Giovanni
    Calcagno, Salvatore
    Palazzo, Simone
    ARTIFICIAL INTELLIGENCE IN PANCREATIC DISEASE DETECTION AND DIAGNOSIS, AND PERSONALIZED INCREMENTAL LEARNING IN MEDICINE, AIPAD 2024, PILM 2024, 2025, 15197 : 86 - 101
  • [4] ERTNet: an interpretable transformer-based framework for EEG emotion recognition
    Liu, Ruixiang
    Chao, Yihu
    Ma, Xuerui
    Sha, Xianzheng
    Sun, Limin
    Li, Shuo
    Chang, Shijie
    FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [5] Transformer-Based Self-Supervised Learning for Emotion Recognition
    Vazquez-Rodriguez, Juan
    Lefebvre, Gregoire
    Cumin, Julien
    Crowley, James L.
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2605 - 2612
  • [6] A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis
    Delbrouck, Jean-Benoit
    Tits, Noe
    Brousmiche, Mathilde
    Dupont, Stephane
    PROCEEDINGS OF THE SECOND GRAND CHALLENGE AND WORKSHOP ON MULTIMODAL LANGUAGE (CHALLENGE-HML), VOL 1, 2020, : 1 - 7
  • [7] Multimodal Emotion Recognition With Transformer-Based Self Supervised Feature Fusion
    Siriwardhana, Shamane
    Kaluarachchi, Tharindu
    Billinghurst, Mark
    Nanayakkara, Suranga
    IEEE ACCESS, 2020, 8 (08): : 176274 - 176285
  • [8] A spatial and temporal transformer-based EEG emotion recognition in VR environment
    Li, Ming
    Yu, Peng
    Shen, Yang
    FRONTIERS IN HUMAN NEUROSCIENCE, 2025, 19
  • [9] Transformer-based approach for symptom recognition and multilingual linking
    Vassileva, Sylvia
    Grazhdanski, Georgi
    Koychev, Ivan
    Boytcheva, Svetla
    DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION, 2024, 2024
  • [10] A Transformer-Based Approach for Better Hand Gesture Recognition
    Besrour, Sinda
    Surapaneni, Yogesh
    Mubibya, Gael S.
    Ashkar, Fahim
    Almhana, Jalal
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 1135 - 1140