EmoGest: Investigating the Impact of Emotions on Spontaneous Co-speech Gestures

被引:0
|
作者
Bergmann, Kirsten [1 ]
Boeck, Ronald [2 ]
Jaecks, Petra [3 ]
机构
[1] Univ Bielefeld, Fac Technol, D-33501 Bielefeld, Germany
[2] Univ Magdeburg, Cognit Syst Grp, D-39106 Magdeburg, Germany
[3] Univ Bielefeld, Fac Linguist & Literary Studies, D-33501 Bielefeld, Germany
关键词
Emotions; priming; multimodal; co-speech gestures; corpus collection; audio feature analysis; RECOGNITION; CLASSIFICATION; FEATURES; MUSIC;
D O I
暂无
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Spontaneous co-speech gestures are an integral part of human communicative behavior. Little is known, however, about how they reflect a speaker's emotional state. In this paper, we describe the setup of a novel body movement database. 32 participants were primed with emotions (happy, sad, neutral) by listening to selected music pieces and, subsequently, fulfilled a gesture-eliciting task. We present our methodology of evaluating the effects of emotion priming with standardized questionnaires, and via automatic emotion recognition of the speech signal. First results suggest that emotional priming was successful, thus, paving the way for further analyses comparing the gestural behavior across the three experimental conditions.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Exploring Emotions Through Co-speech Gestures: The Caveats and New Directions
    Aslan, Zeynep
    Ozer, Demet
    Goksun, Tilbe
    [J]. EMOTION REVIEW, 2024, 16 (04) : 265 - 275
  • [2] Disposition Recognition from Spontaneous Speech Towards a Combination with Co-speech Gestures
    Boeck, Ronald
    Bergmann, Kirsten
    Jaecks, Petra
    [J]. MULTIMODAL ANALYSES ENABLING ARTIFICIAL AGENTS IN HUMAN-MACHINE INTERACTION, 2015, 8757 : 57 - 66
  • [3] Adding and subtracting by hand: Metaphorical representations of arithmetic in spontaneous co-speech gestures
    Alcaraz-Carrion, Daniel
    Alibali, Martha W.
    Valenzuela, Javier
    [J]. ACTA PSYCHOLOGICA, 2022, 228
  • [4] SENSORIMOTOR CORTEX AND UNDERSTANDING CO-SPEECH GESTURES
    Coulson, Seana
    Wu, Ying Choon
    Makeig, Scott
    [J]. PSYCHOPHYSIOLOGY, 2015, 52 : S17 - S17
  • [5] Neural correlates of the processing of co-speech gestures
    Holle, Henning
    Gunter, Thomas C.
    Rueschemeyer, Shirley-Ann
    Hennenlotter, Andreas
    Iacoboni, Marco
    [J]. NEUROIMAGE, 2008, 39 (04) : 2010 - 2024
  • [6] Judgmental perception of co-speech gestures in MDD
    Van den Bossche, Cathy
    Wolf, Dhana
    Rekittke, Linn-Marlen
    Mittelberg, Irene
    Mathiak, Klaus
    [J]. JOURNAL OF AFFECTIVE DISORDERS, 2021, 291 : 46 - 56
  • [7] Speaker Extraction With Co-Speech Gestures Cue
    Pan, Zexu
    Qian, Xinyuan
    Li, Haizhou
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1467 - 1471
  • [8] Speaking with your hands in Parkinson's: Investigating the rate and precision of co-speech gestures
    Poliakoff, E.
    Marciniak, M.
    Bettis, A.
    Humphries, S.
    [J]. MOVEMENT DISORDERS, 2021, 36 : S492 - S492
  • [9] Co-speech gestures in a naming task: Developmental data
    Stefanini, Silvia
    Bello, Arianna
    Caselli, Maria Cristina
    Iverson, Jana M.
    Volterra, Virginia
    [J]. LANGUAGE AND COGNITIVE PROCESSES, 2009, 24 (02): : 168 - 189
  • [10] Effects of linguistic context on the acceptability of co-speech gestures
    Zlogar, Christina
    Davidson, Kathryn
    [J]. GLOSSA-A JOURNAL OF GENERAL LINGUISTICS, 2018, 3 (01):