Facial Emotion Recognition Using Context Based Multimodal Approach

被引:8
|
作者
Metri, Priya [1 ]
Ghorpade, Jayshree [1 ]
Butalia, Ayesha [1 ]
机构
[1] MIT COE, Dept Comp Engn, Pune, Maharashtra, India
关键词
Emotion recognition; Multimodal approach; Face Detection; Facial Action Units; Facial expression recognition system; Body posture recognition system;
D O I
10.9781/ijimai.2011.142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotions play a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. The ability to understand human emotions is desirable for the computer in several applications especially by observing facial expressions. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user's emotional expressions we present a approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand and body posture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. Multimodal system gives more accurate result than a signal or bimodal system
引用
收藏
页码:13 / 16
页数:4
相关论文
共 50 条
  • [1] Emotion Recognition Using Multimodal Approach
    Saini, Samiksha
    Rao, Rohan
    Vaichole, Vinit
    Rane, Anand
    Abin, Deepa
    2018 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING COMMUNICATION CONTROL AND AUTOMATION (ICCUBEA), 2018,
  • [2] Emotion Recognition from EEG and Facial Expressions: a Multimodal Approach
    Chaparro, Valentina
    Gomez, Alejandro
    Salgado, Alejandro
    Quintero, O. Lucia
    Lopez, Natalia
    Villa, Luisa F.
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 530 - 533
  • [3] A Multimodal Emotion Recognition System Using Facial Landmark Analysis
    Farhad Rahdari
    Esmat Rashedi
    Mahdi Eftekhari
    Iranian Journal of Science and Technology, Transactions of Electrical Engineering, 2019, 43 : 171 - 189
  • [4] A Multimodal Emotion Recognition System Using Facial Landmark Analysis
    Rahdari, Farhad
    Rashedi, Esmat
    Eftekhari, Mahdi
    IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2019, 43 (Suppl 1) : 171 - 189
  • [5] A multimodal emotion recognition method based on facial expressions and electroencephalography
    Tan, Ying
    Sun, Zhe
    Duan, Feng
    Sole-Casals, Jordi
    Caiafa, Cesar F.
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 70
  • [6] Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG
    Pan, Jiahui
    Fang, Weijie
    Zhang, Zhihang
    Chen, Bingzhi
    Zhang, Zheng
    Wang, Shuihua
    IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY, 2024, 5 : 396 - 403
  • [7] Multimodal (Audio, Facial and Gesture) based Emotion Recognition challenge
    Wei, Gou
    Li Jian
    Mo, Sun
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 908 - 911
  • [8] Multimodal Emotion Recognition Based on Facial Expression and ECG Signal
    NIU Jianwei
    AN Yueqi
    NI Jie
    JIANG Changhua
    包装工程, 2022, 43 (04) : 71 - 79
  • [9] Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
    Colaco, Savina Jassica
    Han, Dong Seog
    IEEE ACCESS, 2025, 13 : 20778 - 20791
  • [10] Use of multimodal information in facial emotion recognition
    De Silva, LC
    Miyasato, T
    Nakatsu, R
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 1998, E81D (01) : 105 - 114