Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism

被引:0
|
作者
Colaco, Savina Jassica [1 ]
Han, Dong Seog [2 ]
机构
[1] Kyungpook Natl Univ, Ctr ICT & Automot Convergence, Daegu 41566, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
来源
IEEE ACCESS | 2025年 / 13卷
基金
新加坡国家研究基金会;
关键词
Emotion recognition; Face recognition; Feature extraction; Accuracy; Representation learning; Attention mechanisms; Visualization; Scalability; Kernel; Image recognition; Contextual cues; deep learning; emotion recognition; facial landmarks; scalable models; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3534328
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deciphering emotions from a person's perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model's robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.
引用
收藏
页码:20778 / 20791
页数:14
相关论文
共 50 条
  • [31] GA-SVM-Based Facial Emotion Recognition Using Facial Geometric Features
    Liu, Xiao
    Cheng, Xiangyi
    Lee, Kiju
    IEEE SENSORS JOURNAL, 2021, 21 (10) : 11532 - 11542
  • [32] Emotion recognition based on facial components
    Rani, P. Ithaya
    Muneeswaran, K.
    SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 2018, 43 (03):
  • [33] SELECTIVE ATTENTION TO FACIAL IDENTITY AND FACIAL EMOTION
    ETCOFF, NL
    NEUROPSYCHOLOGIA, 1984, 22 (03) : 281 - &
  • [34] Facial emotion recognition on video using deep attention based bidirectional LSTM with equilibrium optimizer
    Vedantham, Ramachandran
    Reddy, Edara Sreenivasa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (19) : 28681 - 28711
  • [35] Facial emotion recognition on video using deep attention based bidirectional LSTM with equilibrium optimizer
    Ramachandran Vedantham
    Edara Sreenivasa Reddy
    Multimedia Tools and Applications, 2023, 82 : 28681 - 28711
  • [36] Facial Emotion Recognition
    Ma Xiaoxi
    Lin Weisi
    Huang Dongyan
    Dong Minghui
    Li, Haizhou
    2017 IEEE 2ND INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2017, : 77 - 81
  • [37] Facial Expressions and Body Postures Emotion Recognition based on Convolutional Attention Network
    Zhou, Tiehua
    Gao, Shiru
    Mei, Yuanhao
    Wang, Ling
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTER, INFORMATION, AND TELECOMMUNICATION SYSTEMS (IEEE CITS 2021), 2021, : 108 - 112
  • [38] A Novel Face Recognition Method using Facial Landmarks
    Nagamalla, Srinivas
    Dhara, Bibhas Chandra
    ICAPR 2009: SEVENTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION, PROCEEDINGS, 2009, : 445 - 448
  • [39] Emotion regulates attention:: The relation between facial configurations, facial emotion, and visual attention
    Lundqvist, D
    Öhman, A
    VISUAL COGNITION, 2005, 12 (01) : 51 - 84
  • [40] Emotion Recognition System Based on Facial Expressions Using SVM
    Abdul-Majjed, Ielaf Osaamah
    RECENT DEVELOPMENTS IN INTELLIGENT COMPUTING, COMMUNICATION AND DEVICES, ICCD 2016, 2017, 555 : 31 - 35