Gesture style can affect the integration of gestures and speech: the evidence from Chinese ERP research

被引:0
|
作者
Sun, Fang [1 ]
Xiang, Huiwen [2 ]
Hu, Xinzhuo [2 ]
Li, Yutong [2 ]
Sui, Xue [2 ]
机构
[1] Liaoning Normal Univ, Sch Comp & Informat Technol, Dalian, Peoples R China
[2] Liaoning Normal Univ, Sch Psychol, Dalian, Peoples R China
关键词
disambiguation effect; gesture-speech integration; iconic gesture; N400; N400;
D O I
10.1097/WNR.0000000000001458
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
People often accompany gestures in the process of speaking, but the individual's gesture style is not the same. The present study uses the ambiguity resolution paradigm to explore the influence of two kinds of gesture styles on gesture-verbal comprehension. The study manipulated the gesture styles and meaning types of target words and recorded N400 amplitude. This study found that (1) in the non-grooming condition, compared with the situation where the gesture and semantics are inconsistent, a smaller N400 appears under the consistent condition; (2) in the grooming condition, the grooming gesture will reduce the effect of the iconic gesture on speech understanding. N400 amplitude increased only in the case of matching between dominant meaning gesture and subordinate meaning target word. These results suggest that the communication styles of gestures of different speakers, in the process of speech comprehension, affect how well listeners integrate gestures and language.
引用
收藏
页码:885 / 890
页数:6
相关论文
共 50 条
  • [21] Covert negation in Israeli Hebrew: Evidence from co-speech gestures
    Inbar, Anna
    Shor, Leon
    [J]. JOURNAL OF PRAGMATICS, 2019, 143 : 85 - 95
  • [22] SEGMENTAL GESTURES AT THE LARYNGEAL LEVEL IN WHISPERED SPEECH - EVIDENCE FROM AN AERODYNAMIC STUDY
    WEISMER, G
    LONGSTRETH, D
    [J]. JOURNAL OF SPEECH AND HEARING RESEARCH, 1980, 23 (02): : 383 - 392
  • [23] How Referential Gestures Align With Speech: Evidence From Monolingual and Bilingual Speakers
    Graziano, Maria
    Nicoladis, Elena
    Marentette, Paula
    [J]. LANGUAGE LEARNING, 2020, 70 (01) : 266 - 304
  • [24] Abstract Phonemic Representations Affect Speech Production: Evidence from Speech Impairment
    Buchwald, Adam
    Miozzo, Michele
    [J]. AOA2010, 48TH ACADEMY OF APHASIA PROCEEDINGS, 2010, 6 : 128 - +
  • [25] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
    Florian Hintz
    Yung Han Khoe
    Antje Strauß
    Adam Johannes Alfredo Psomakas
    Judith Holler
    [J]. Cognitive, Affective, & Behavioral Neuroscience, 2023, 23 : 340 - 353
  • [26] Interaction and representational integration: Evidence from speech errors
    Goldrick, Matthew
    Baker, H. Ross
    Murphy, Amanda
    Baese-Berk, Melissa
    [J]. COGNITION, 2011, 121 (01) : 58 - 72
  • [27] Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension
    Hintz, Florian
    Khoe, Yung Han
    Strauss, Antje
    Psomakas, Adam Johannes Alfredo
    Holler, Judith
    [J]. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2023, 23 (02) : 340 - 353
  • [28] When Gestures Do or Do Not Follow Language-Specific Patterns of Motion Expression in Speech: Evidence from Chinese, English and Turkish
    Tutuncu, Irmak Su
    Paul, Jing
    Emerson, Samantha N.
    Sengul, Murat
    Knezevic, Melanie
    Ozcaliskan, Seyda
    [J]. COGNITIVE SCIENCE, 2023, 47 (04)
  • [29] The influence of temporal asynchrony on character-speech integration in Chinese children with and without dyslexia: An ERP study
    Du, Ying-Chun
    Li, Yi-Zhen
    Qin, Li
    Bi, Hong-Yan
    [J]. BRAIN AND LANGUAGE, 2022, 233
  • [30] When Speech Stops, Gesture Stops: Evidence From Developmental and Crosslinguistic Comparisons
    Graziano, Maria
    Gullberg, Marianne
    [J]. FRONTIERS IN PSYCHOLOGY, 2018, 9