Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [31] Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis
    Kessous, Loic
    Castellano, Ginevra
    Caridakis, George
    JOURNAL ON MULTIMODAL USER INTERFACES, 2010, 3 (1-2) : 33 - 48
  • [32] Multimodal Emotion Recognition From EEG Signals and Facial Expressions
    Wang, Shuai
    Qu, Jingzi
    Zhang, Yong
    Zhang, Yidie
    IEEE ACCESS, 2023, 11 : 33061 - 33068
  • [33] Fusing facial and speech cues for enhanced multimodal emotion recognition
    Tomar P.S.
    Mathur K.
    Suman U.
    International Journal of Information Technology, 2024, 16 (3) : 1397 - 1405
  • [34] Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis
    Loic Kessous
    Ginevra Castellano
    George Caridakis
    Journal on Multimodal User Interfaces, 2010, 3 : 33 - 48
  • [35] Emotion Recognition using Multimodal Features
    Zhao, Jinming
    Chen, Shizhe
    Wang, Shuai
    Jin, Qin
    2018 FIRST ASIAN CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII ASIA), 2018,
  • [36] Multimodal machine learning approach for emotion recognition using physiological signals
    Ramadan, Mohamad A.
    Salem, Nancy M.
    Mahmoud, Lamees N.
    Sadek, Ibrahim
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [37] Multimodal approach for emotion recognition using an algebraic representation of emotional states
    Meftah, Imen Tayari
    Nhan Le Thanh
    Ben Amar, Chokri
    8TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS 2012), 2012, : 541 - 546
  • [38] Context Based Emotion Recognition Using EMOTIC Dataset
    Kosti, Ronak
    Alvarez, Jose M.
    Recasens, Adria
    Lapedriza, Agata
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (11) : 2755 - 2766
  • [39] Emotion Recognition Based on Multimodal Information
    Zeng, Zhihong
    Pantic, Maja
    Huang, Thomas S.
    AFFECTIVE INFORMATION PROCESSING, 2009, : 241 - +
  • [40] Emotion Recognition Using Facial Expressions
    Jasuja, Arush
    Rathee, Sonia
    INTERNATIONAL JOURNAL OF INFORMATION RETRIEVAL RESEARCH, 2021, 11 (03) : 1 - 17