Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism

被引:0
|
作者
Colaco, Savina Jassica [1 ]
Han, Dong Seog [2 ]
机构
[1] Kyungpook Natl Univ, Ctr ICT & Automot Convergence, Daegu 41566, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
来源
IEEE ACCESS | 2025年 / 13卷
基金
新加坡国家研究基金会;
关键词
Emotion recognition; Face recognition; Feature extraction; Accuracy; Representation learning; Attention mechanisms; Visualization; Scalability; Kernel; Image recognition; Contextual cues; deep learning; emotion recognition; facial landmarks; scalable models; EXPRESSION RECOGNITION;
D O I
10.1109/ACCESS.2025.3534328
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deciphering emotions from a person's perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model's robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.
引用
收藏
页码:20778 / 20791
页数:14
相关论文
共 50 条
  • [21] Recognition and segmentation of facial components using selective attention mechanism
    Hashimoto, Hideki
    Fukushima, Kunihiko
    Systems and Computers in Japan, 1999, 30 (09): : 55 - 63
  • [22] Emotion recognition using facial expressions
    Tarnowski, Pawel
    Kolodziej, Marcin
    Majkowski, Andrzej
    Rak, Remigiusz J.
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 1175 - 1184
  • [23] Emotion Sensing Using Facial Recognition
    Shivashankar, Shreya Gulur
    Hiremath, Sushant
    PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES FOR SMART NATION (SMARTTECHCON), 2017, : 830 - 833
  • [24] I Know How You Feel: Emotion Recognition with Facial Landmarks
    Tautkute, Ivona
    Trzcinski, Tomasz
    Bielski, Adam
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1959 - 1961
  • [25] A classroom facial expression recognition method based on attention mechanism
    Jin, Huilong
    Du, Ruiyan
    Wen, Tian
    Zhao, Jia
    Shi, Lei
    Zhang, Shuang
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 11873 - 11882
  • [26] Facial expression recognition based on attention mechanism and feature correlation
    Lan L.
    Liu Q.
    Lu S.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 48 (01): : 147 - 155
  • [27] Attention mechanism-based CNN for facial expression recognition
    Li, Jing
    Jin, Kan
    Zhou, Dalin
    Kubota, Naoyuki
    Ju, Zhaojie
    NEUROCOMPUTING, 2020, 411 : 340 - 350
  • [28] Facial Emotion Recognition Based on CNN
    Liu, Shuang
    Li, Dahua
    Gao, Qiang
    Song, Yu
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 398 - 403
  • [29] Emotion recognition based on facial components
    P ITHAYA RANI
    K MUNEESWARAN
    Sādhanā, 2018, 43
  • [30] Facial Expression Recognition Based on Multiscale Features and Attention Mechanism
    Yao, Lisha
    AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2024, 58 (04) : 429 - 440