Bimodal Emotion Recognition

被引:0
|
作者
Paleari, Marco [1 ,2 ]
Chellali, Ryad [1 ]
Huet, Benoit [2 ]
机构
[1] Italian Inst Technol, TERA Dept, Genoa, Italy
[2] EURECOM, Multimedia Dept, Paris, France
来源
SOCIAL ROBOTICS, ICSR 2010 | 2010年 / 6414卷
关键词
Emotion recognition; facial expressions; vocal expressions; prosody; affective computing; HRI;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When interacting with robots we show a plethora of affective reactions typical of natural communications. Indeed, emotions are embedded on our communications and represent a predominant communication channel to convey relevant, high impact, information. In recent years more and more researchers have tried to exploit this channel for human robot (HRI) and human computer interactions (HCI). Two key abilities are needed for this purpose: the ability to display emotions and the ability to automatically recognize them. In this work we present our system for the computer based automatic recognition of emotions and the new results we obtained on a small dataset of quasi unconstrained emotional videos extracted from TV series and movies. The results are encouraging showing a recognition rate of about 74%.
引用
收藏
页码:305 / 314
页数:10
相关论文
共 50 条
  • [21] Convolutional Neural Networks and Feature fusion for Bimodal Emotion Recognition on the EmotiW 2016 Challenge
    Yan, Jingjie
    Yan, Bojie
    Lu, Guanming
    Xu, Qinyu
    Li, Haibo
    Cheng, Xiaogang
    Cai, Xia
    2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [22] Expression-EEG Bimodal Fusion Emotion Recognition Method Based on Deep Learning
    Lu, Yu
    Zhang, Hua
    Shi, Lei
    Yang, Fei
    Li, Jing
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
  • [23] Hybrid Feature and Decision Level Fusion of Face and Speech Information for Bimodal Emotion Recognition
    Mansoorizadeh, Muharram
    Charkari, Nasrollah Moghaddam
    2009 14TH INTERNATIONAL COMPUTER CONFERENCE, 2009, : 651 - 656
  • [24] BIMODAL EMOTION DEPTH RECOGNITION METHOD OF FACIAL EXPRESSION AND POSTURE IN CYBER-PHYSICAL SYSTEMS
    Ye, Haiyan
    Wu, Qilin
    MECHATRONIC SYSTEMS AND CONTROL, 2024, 52 (01): : 1 - 10
  • [25] Bimodal Feature-based Fusion for Real-Time Emotion Recognition in a Mobile Context
    Gievska, Sonja
    Koroveshovski, Kiril
    Tagasovska, Natasha
    2015 INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2015, : 401 - 407
  • [26] Kernel Cross-Modal Factor Analysis for Information Fusion With Application to Bimodal Emotion Recognition
    Wang, Yongjin
    Guan, Ling
    Venetsanopoulos, Anastasios N.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2012, 14 (03) : 597 - 607
  • [27] Research on emotion recognition of bimodal bioelectrical features based on D-S evidence theory
    Qin, Xuebin
    Yang, Dan
    Pan, Siyu
    Yuan, Qinhe
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
  • [28] Efficient bimodal emotion recognition system based on speech/text embeddings and ensemble learning fusion
    Chakhtouna, Adil
    Sekkate, Sara
    Adib, Abdellah
    ANNALS OF TELECOMMUNICATIONS, 2025,
  • [29] Audio and Video Bimodal Emotion Recognition in Social Networks Based on Improved AlexNet Network and Attention Mechanism
    Liu, Min
    Tang, Jun
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2021, 17 (04): : 754 - 771
  • [30] A bimodal network based on Audio-Text-Interactional-Attention with ArcFace loss for speech emotion recognition
    Tang, Yuwu
    Hu, Ying
    He, Liang
    Huang, Hao
    SPEECH COMMUNICATION, 2022, 143 : 21 - 32