A speaker's gesture style can affect language comprehension: ERP evidence from gesture-speech integration

被引:18
|
作者
Obermeier, Christian [1 ]
Kelly, Spencer D. [2 ]
Gunter, Thomas C. [1 ]
机构
[1] Max Planck Inst Human Cognit & Brain Sci, Dept Neuropsychol, D-04303 Leipzig, Germany
[2] Colgate Univ, Dept Psychol, Hamilton, NY 13346 USA
关键词
indexical cues; individual differences; gesture-speech integration; disambiguation; N400; COMMUNICATION EVIDENCE; N400; CONTEXT;
D O I
10.1093/scan/nsv011
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In face-to-face communication, speech is typically enriched by gestures. Clearly, not all people gesture in the same way, and the present study explores whether such individual differences in gesture style are taken into account during the perception of gestures that accompany speech. Participants were presented with one speaker that gestured in a straightforward way and another that also produced self-touch movements. Adding trials with such grooming movements makes the gesture information a much weaker cue compared with the gestures of the non-grooming speaker. The Electroencephalogram was recorded as participants watched videos of the individual speakers. Event-related potentials elicited by the speech signal revealed that adding grooming movements attenuated the impact of gesture for this particular speaker. Thus, these data suggest that there is sensitivity to the personal communication style of a speaker and that affects the extent to which gesture and speech are integrated during language comprehension.
引用
收藏
页码:1236 / 1243
页数:8
相关论文
共 15 条
  • [1] Gesture style can affect the integration of gestures and speech: the evidence from Chinese ERP research
    Sun, Fang
    Xiang, Huiwen
    Hu, Xinzhuo
    Li, Yutong
    Sui, Xue
    NEUROREPORT, 2020, 31 (12) : 885 - 890
  • [2] The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony
    Regel, Stefanie
    Coulson, Seana
    Gunter, Thomas C.
    BRAIN RESEARCH, 2010, 1311 : 121 - 135
  • [3] Gesture-speech integration in children with specific language impairment
    Mainela-Arnold, Elina
    Alibali, Martha W.
    Hostetter, Autumn B.
    Evans, Julia L.
    INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS, 2014, 49 (06) : 761 - 770
  • [4] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
    Hintz, Florian
    Khoe, Yung Han
    Strauss, Antje
    Psomakas, Adam Johannes Alfredo
    Holler, Judith
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2023, 23 (02) : 340 - 353
  • [5] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
    Florian Hintz
    Yung Han Khoe
    Antje Strauß
    Adam Johannes Alfredo Psomakas
    Judith Holler
    Cognitive, Affective, & Behavioral Neuroscience, 2023, 23 : 340 - 353
  • [6] What Iconic Gesture Fragments Reveal about Gesture-Speech Integration: When Synchrony Is Lost, Memory Can Help
    Obermeier, Christian
    Holle, Henning
    Gunter, Thomas C.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2011, 23 (07) : 1648 - 1663
  • [7] High verbal working memory load impairs gesture-speech integration Evidence from a dual task paradigm
    Arachchige, Kendra G. Kandana
    Holle, Henning
    Rossignol, Mandy
    Loureiro, Isabelle Simoes
    Lefebvre, Laurent
    GESTURE, 2021, 20 (03) : 354 - 375
  • [8] Gesture-speech integration is related to vocabulary skills in children with developmental language disorder, Williams syndrome and typical development
    Rombouts, Ellen
    Leenen, Liesl
    Maes, Bea
    Zink, Inge
    INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS, 2023, 58 (01) : 206 - 220
  • [9] Listeners consider alternative speaker productions in discourse comprehension and memory: Evidence from beat gesture and pitch accenting
    Laura M. Morett
    Scott H. Fraundorf
    Memory & Cognition, 2019, 47 : 1515 - 1530
  • [10] Listeners consider alternative speaker productions in discourse comprehension and memory: Evidence from beat gesture and pitch accenting
    Morett, Laura M.
    Fraundorf, Scott H.
    MEMORY & COGNITION, 2019, 47 (08) : 1515 - 1530