Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism

被引:0
|
作者
Colaco, Savina Jassica [1 ]
Han, Dong Seog [2 ]
机构
[1] Kyungpook Natl Univ, Ctr ICT & Automot Convergence, Daegu 41566, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
来源
IEEE ACCESS | 2025年 / 13卷
基金
新加坡国家研究基金会;
关键词
Emotion recognition; Face recognition; Feature extraction; Accuracy; Representation learning; Attention mechanisms; Visualization; Scalability; Kernel; Image recognition; Contextual cues; deep learning; emotion recognition; facial landmarks; scalable models; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3534328
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deciphering emotions from a person's perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model's robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.
引用
收藏
页码:20778 / 20791
页数:14
相关论文
共 50 条
  • [1] Deep Facial Emotion Recognition Using Local Features Based on Facial Landmarks for Security System
    An, Youngeun
    Lee, Jimin
    Bak, Eunsang
    Pan, Sungbum
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (02): : 1817 - 1832
  • [2] Feature Vector Extraction Technique for Facial Emotion Recognition Using Facial Landmarks
    Poulose, Alwin
    Kim, Jung Hwan
    Han, Dong Seog
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 1072 - 1076
  • [3] Facial Emotion Recognition Using Context Based Multimodal Approach
    Metri, Priya
    Ghorpade, Jayshree
    Butalia, Ayesha
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2011, 1 (04): : 13 - 16
  • [4] Facial expression recognition based on facial part attention mechanism
    Zhong, Qiubo
    Fang, Baofu
    Wei, Shenbin
    Wang, Zaijun
    Zhang, Haoxiang
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
  • [5] Emotion Recognition on Selected Facial Landmarks Using Supervised Learning Algorithms
    Baculo, Maria Jeseca C.
    Azcarraga, Judith J.
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 1483 - 1489
  • [6] Emotion Recognition using Spatiotemporal Features from Facial Expression Landmarks
    Golzadeh, Hamid
    Faria, Diego R.
    Manso, Luis J.
    Ekart, Aniko
    Buckingham, Christopher D.
    2018 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS (IS), 2018, : 789 - 794
  • [7] Facial Expression Recognition Based on Attention Mechanism
    Jiang, Daihong
    Hu, Yuanzheng
    Lei, Dai
    Jin, Peng
    SCIENTIFIC PROGRAMMING, 2021, 2021
  • [8] Face Recognition Based on Facial Landmarks
    Sarsenov, Adil
    Latuta, Konstantin
    2017 11TH IEEE INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT 2017), 2017, : 213 - 217
  • [9] Toward Personalized Emotion Recognition: A Face Recognition Based Attention Method for Facial Emotion Recognition
    Shahabinejad, Mostafa
    Wang, Yang
    Yu, Yuanhao
    Tang, Jin
    Li, Jiani
    2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [10] Facial Expression Recognition Network Based on Attention Mechanism
    Zhang W.
    Li P.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2022, 55 (07): : 706 - 713