Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [21] Multimodal emotion recognition from facial expression and speech based on feature fusion
    Guichen Tang
    Yue Xie
    Ke Li
    Ruiyu Liang
    Li Zhao
    Multimedia Tools and Applications, 2023, 82 : 16359 - 16373
  • [22] Multimodal emotion recognition from facial expression and speech based on feature fusion
    Tang, Guichen
    Xie, Yue
    Li, Ke
    Liang, Ruiyu
    Zhao, Li
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (11) : 16359 - 16373
  • [23] IoT-based approach to multimodal music emotion recognition
    Zhao, Hanbing
    Jin, Ling
    ALEXANDRIA ENGINEERING JOURNAL, 2025, 113 : 19 - 31
  • [24] Multimodal Approach for Emotion Recognition Based on Simulated Flight Experiments
    Cavalcanti Roza, Valber Cesar
    Postolache, Octavian Adrian
    SENSORS, 2019, 19 (24)
  • [25] A Fuzzy Approach for Facial Emotion Recognition
    Farahani, Fatemeh Shahrabi
    Sheikhan, Mansour
    Farrokhi, Ali
    2013 13TH IRANIAN CONFERENCE ON FUZZY SYSTEMS (IFSC), 2013,
  • [26] Bimodal Approach in Emotion Recognition using Speech and Facial Expressions
    Emerich, Simina
    Lupu, Eugen
    Apatean, Anca
    ISSCS 2009: INTERNATIONAL SYMPOSIUM ON SIGNALS, CIRCUITS AND SYSTEMS, VOLS 1 AND 2, PROCEEDINGS,, 2009, : 297 - 300
  • [27] Facial emotion recognition based on deep transfer learning approach
    Aziza Sultana
    Samrat Kumar Dey
    Md. Armanur Rahman
    Multimedia Tools and Applications, 2023, 82 : 44175 - 44189
  • [28] Facial emotion recognition based on deep transfer learning approach
    Sultana, Aziza
    Dey, Samrat Kumar
    Rahman, Md. Armanur
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (28) : 44175 - 44189
  • [29] Context-aware Multimodal Fusion for Emotion Recognition
    Li, Jinchao
    Wang, Shuai
    Chao, Yang
    Liu, Xunying
    Meng, Helen
    INTERSPEECH 2022, 2022, : 2013 - 2017
  • [30] Multimodal Emotion Recognition: Emotion Classification Through the Integration of EEG and Facial Expressions
    Guler, Songul Erdem
    Akbulut, Fatma Patlar
    IEEE ACCESS, 2025, 13 : 24587 - 24603