Automated Recognition of Affect and Stress evoked by Audio-Visual stimuli

被引:0
|
作者
Markova, Valentina [1 ]
Ganchev, Todor [2 ]
机构
[1] Tech Univ Varna, Dept Commun Engn & Technol, Varna, Bulgaria
[2] Tech Univ Varna, Dept Compute Sci & Engn, Varna, Bulgaria
关键词
Emotion recognition; Stress detection; electrocardiography (ECG); galvanic skin response (GSR);
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the present work, we consider the automated detection of negative emotions and high-arousal negative-valence (HANV) states, which are akin to acute stress occurring in specific context. We investigate the influence and intricacy which subjective perception of negative emotions and acute stress brings to the process of automated recognition of these states. For that purpose we experimentally evaluate the advantages of modelling based on the person-independent tags of the audio-video stimuli, and models built with the person-specific self-reported tags. Based on the self-reported tags, which are obtained with only tiny extra effort, we report a relative improvement of the HANV detection accuracy with up to 5%.
引用
收藏
页码:115 / 118
页数:4
相关论文
共 50 条
  • [1] Audio-visual affect recognition
    Zeng, Zhihong
    Tu, Jilin
    Liu, Ming
    Huang, Thomas S.
    Pianfetti, Brian
    Roth, Dan
    Levinson, Stephen
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (02) : 424 - 428
  • [2] Audio-visual affect recognition in activation-evaluation space
    Zeng, ZH
    Zhang, ZQ
    Pianfetti, B
    Tu, JL
    Huang, TS
    [J]. 2005 IEEE International Conference on Multimedia and Expo (ICME), Vols 1 and 2, 2005, : 828 - 831
  • [3] An audio-visual speech recognition with a new mandarin audio-visual database
    Liao, Wen-Yuan
    Pao, Tsang-Long
    Chen, Yu-Te
    Chang, Tsun-Wei
    [J]. INT CONF ON CYBERNETICS AND INFORMATION TECHNOLOGIES, SYSTEMS AND APPLICATIONS/INT CONF ON COMPUTING, COMMUNICATIONS AND CONTROL TECHNOLOGIES, VOL 1, 2007, : 19 - +
  • [4] Audio-visual gender recognition
    Liu, Ming
    Xu, Xun
    Huang, Thomas S.
    [J]. MIPPR 2007: PATTERN RECOGNITION AND COMPUTER VISION, 2007, 6788
  • [5] Audio-Visual Causality and Stimulus Reliability Affect Audio-Visual Synchrony Perception
    Li, Shao
    Ding, Qi
    Yuan, Yichen
    Yue, Zhenzhu
    [J]. FRONTIERS IN PSYCHOLOGY, 2021, 12
  • [6] MetaHug: Audio-Visual Stimuli Change Stress Buffer Effect of Hug
    Shiomi, Masahiro
    Hagita, Norihiro
    [J]. 2018 27TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN 2018), 2018, : 336 - 341
  • [7] Audio-Visual Gated-Sequenced Neural Networks for Affect Recognition
    Aspandi, Decky
    Sukno, Federico
    Schuller, Bjorn W.
    Binefa, Xavier
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2193 - 2208
  • [8] Multi-stream confidence analysis for audio-visual affect recognition
    Zeng, ZH
    Tu, JL
    Liu, M
    Huang, TS
    [J]. AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION, PROCEEDINGS, 2005, 3784 : 964 - 971
  • [9] An audio-visual speech recognition system for testing new audio-visual databases
    Pao, Tsang-Long
    Liao, Wen-Yuan
    [J]. VISAPP 2006: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, 2006, : 192 - +
  • [10] LEARNING CONTEXTUALLY FUSED AUDIO-VISUAL REPRESENTATIONS FOR AUDIO-VISUAL SPEECH RECOGNITION
    Zhang, Zi-Qiang
    Zhang, Jie
    Zhang, Jian-Shu
    Wu, Ming-Hui
    Fang, Xin
    Dai, Li-Rong
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1346 - 1350