Gesture style can affect the integration of gestures and speech: the evidence from Chinese ERP research

被引:0
|
作者
Sun, Fang [1 ]
Xiang, Huiwen [2 ]
Hu, Xinzhuo [2 ]
Li, Yutong [2 ]
Sui, Xue [2 ]
机构
[1] Liaoning Normal Univ, Sch Comp & Informat Technol, Dalian, Peoples R China
[2] Liaoning Normal Univ, Sch Psychol, Dalian, Peoples R China
关键词
disambiguation effect; gesture-speech integration; iconic gesture; N400; N400;
D O I
10.1097/WNR.0000000000001458
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
People often accompany gestures in the process of speaking, but the individual's gesture style is not the same. The present study uses the ambiguity resolution paradigm to explore the influence of two kinds of gesture styles on gesture-verbal comprehension. The study manipulated the gesture styles and meaning types of target words and recorded N400 amplitude. This study found that (1) in the non-grooming condition, compared with the situation where the gesture and semantics are inconsistent, a smaller N400 appears under the consistent condition; (2) in the grooming condition, the grooming gesture will reduce the effect of the iconic gesture on speech understanding. N400 amplitude increased only in the case of matching between dominant meaning gesture and subordinate meaning target word. These results suggest that the communication styles of gestures of different speakers, in the process of speech comprehension, affect how well listeners integrate gestures and language.
引用
收藏
页码:885 / 890
页数:6
相关论文
共 50 条
  • [1] A speaker's gesture style can affect language comprehension: ERP evidence from gesture-speech integration
    Obermeier, Christian
    Kelly, Spencer D.
    Gunter, Thomas C.
    [J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2015, 10 (09) : 1236 - 1243
  • [2] Neural integration of speech and gesture in schizophrenia: Evidence for differential processing of metaphoric gestures
    Straube, Benjamin
    Green, Antonia
    Sass, Katharina
    Kirner-Veselinovic, Andre
    Kircher, Tilo
    [J]. HUMAN BRAIN MAPPING, 2013, 34 (07) : 1696 - 1712
  • [3] Evidence for children's online integration of simultaneous information from speech and iconic gestures: an ERP study
    Sekine, Kazuki
    Schoechl, Christina
    Mulder, Kimberley
    Holler, Judith
    Kelly, Spencer
    Furman, Reyhan
    Ozyurek, Asli
    [J]. LANGUAGE COGNITION AND NEUROSCIENCE, 2020, 35 (10) : 1283 - 1294
  • [4] The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony
    Regel, Stefanie
    Coulson, Seana
    Gunter, Thomas C.
    [J]. BRAIN RESEARCH, 2010, 1311 : 121 - 135
  • [5] The role of iconic gestures in speech disambiguation: ERP evidence
    Holle, Henning
    Gunter, Thomas C.
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2007, 19 (07) : 1175 - 1192
  • [6] Speech2Properties2Gestures: Gesture-Property Prediction as a Tool for Generating Representational Gestures from Speech
    Kucherenko, Taras
    Nagy, Rajmund
    Jonell, Patrik
    Neff, Michael
    Kjellstrom, Hedvig
    Henter, Gustav Eje
    [J]. PROCEEDINGS OF THE 21ST ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (IVA), 2021, : 145 - 147
  • [7] Beyond words: evidence for automatic language–gesture integration of symbolic gestures but not dynamic landscapes
    Dana Vainiger
    Ludovica Labruna
    Richard B. Ivry
    Michal Lavidor
    [J]. Psychological Research, 2014, 78 : 55 - 69
  • [8] Beyond words: evidence for automatic language-gesture integration of symbolic gestures but not dynamic landscapes
    Vainiger, Dana
    Labruna, Ludovica
    Ivry, Richard B.
    Lavidor, Michal
    [J]. PSYCHOLOGICAL RESEARCH-PSYCHOLOGISCHE FORSCHUNG, 2014, 78 (01): : 55 - 69
  • [9] Can pragmatic inference benefit from topic prominence? ERP evidence from Mandarin Chinese
    Chen, Lijuan
    Xu, Xiaodong
    Chen, Qingrong
    Royle, Phaedra
    [J]. JOURNAL OF NEUROLINGUISTICS, 2018, 46 : 11 - 22
  • [10] Representational disfluency in algebra: Evidence from student gestures and speech
    Bieda K.N.
    Nathan M.J.
    [J]. ZDM, 2009, 41 (5): : 637 - 650