Neural integration of speech and gesture in schizophrenia: Evidence for differential processing of metaphoric gestures

被引:40
|
作者
Straube, Benjamin [1 ]
Green, Antonia [1 ]
Sass, Katharina [2 ,3 ]
Kirner-Veselinovic, Andre [2 ,3 ]
Kircher, Tilo [1 ]
机构
[1] Univ Marburg, Dept Psychiat & Psychotherapy, D-35039 Marburg, Germany
[2] Rhein Westfal TH Aachen, Dept Psychiat Psychotherapy & Psychosomat, Aachen, Germany
[3] JARA Translat Brain Med, Aachen, Germany
关键词
co-verbal gestures; metaphoric gestures; iconic gestures; integration; schizophrenia; PREFRONTAL CORTEX; EPISODIC MEMORY; HIPPOCAMPAL DYSFUNCTION; AUDIOVISUAL INTEGRATION; ICONIC GESTURES; BRAIN; COMPREHENSION; RECOGNITION; LANGUAGE; BEHAVIOR;
D O I
10.1002/hbm.22015
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Gestures are an important component of interpersonal communication. Especially, complex multimodal communication is assumed to be disrupted in patients with schizophrenia. In healthy subjects, differential neural integration processes for gestures in the context of concrete [iconic (IC) gestures] and abstract sentence contents [metaphoric (MP) gestures] had been demonstrated. With this study we wanted to investigate neural integration processes for both gesture types in patients with schizophrenia. During functional magnetic resonance imaging-data acquisition, 16 patients with schizophrenia (P) and a healthy control group (C) were shown videos of an actor performing IC and MP gestures and associated sentences. An isolated gesture (G) and isolated sentence condition (S) were included to separate unimodal from bimodal effects at the neural level. During IC conditions (IC > G IC > S) we found increased activity in the left posterior middle temporal gyrus (pMTG) in both groups. Whereas in the control group the left pMTG and the inferior frontal gyrus (IFG) were activated for the MP conditions (MP > G MP > S), no significant activation was found for the identical contrast in patients. The interaction of group (P/C) and gesture condition (MP/IC) revealed activation in the bilateral hippocampus, the left middle/superior temporal and IFG. Activation of the pMTG for the IC condition in both groups indicates intact neural integration of IC gestures in schizophrenia. However, failure to activate the left pMTG and IFG for MP co-verbal gestures suggests a disturbed integration of gestures embedded in an abstract sentence context. This study provides new insight into the neural integration of co-verbal gestures in patients with schizophrenia. Hum Brain Mapp, 2013. (c) 2012 Wiley Periodicals, Inc.
引用
收藏
页码:1696 / 1712
页数:17
相关论文
共 50 条
  • [21] Multimodal language processing: How preceding discourse constrains gesture interpretation and affects gesture integration when gestures do not synchronise with semantic affiliates
    Fritz, Isabella
    Kita, Sotaro
    Littlemore, Jeannette
    Krott, Andrea
    [J]. JOURNAL OF MEMORY AND LANGUAGE, 2021, 117
  • [22] Integrating Speech and Iconic Gestures in a Stroop-like Task: Evidence for Automatic Processing
    Kelly, Spencer D.
    Creigh, Peter
    Bartolotti, James
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2010, 22 (04) : 683 - 694
  • [23] POSTURAL KNOWLEDGE OF GESTURES IN SCHIZOPHRENIA IS LINKED TO STRUCTURAL ALTERATIONS IN KEY REGIONS OF GESTURE PROCESSING AND CONNECTING LONG ASSOCIATION FIBERS
    Stegmayer, Katharina
    Viher, Petra
    Vanbellingen, T.
    Federspiel, A.
    Bohlhalter, S.
    Strik, Werner
    Wiest, R.
    Walther, Sebastian
    [J]. SCHIZOPHRENIA BULLETIN, 2015, 41 : S274 - S275
  • [24] Differential effects of ageing on the neural processing of speech and singing production
    Moisseinen, Nella
    Sarkamo, Teppo
    Kauramaki, Jaakko
    Kleber, Boris
    Sihvonen, Aleksi J.
    Martinez-Molina, Noelia
    [J]. FRONTIERS IN AGING NEUROSCIENCE, 2023, 15
  • [25] A speaker's gesture style can affect language comprehension: ERP evidence from gesture-speech integration
    Obermeier, Christian
    Kelly, Spencer D.
    Gunter, Thomas C.
    [J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2015, 10 (09) : 1236 - 1243
  • [26] Neural correlates of the processing of self-adaptors, emblems, and iconic gestures with speech: an fMRI study
    Chui, Kawai
    Yeh, Kanyu
    Chang, Ting-Ting
    [J]. LANGUAGE COGNITION AND NEUROSCIENCE, 2021, 36 (04) : 401 - 421
  • [27] The connectivity signature of co-speech gesture integration: The superior temporal sulcus modulates connectivity between areas related to visual gesture and auditory speech processing
    Straube, Benjamin
    Wroblewski, Adrian
    Jansen, Andreas
    He, Yifei
    [J]. NEUROIMAGE, 2018, 181 : 539 - 549
  • [28] Processing of Emotions in Speech in Forensic Patients With Schizophrenia: Impairments in Identification, Selective Attention, and Integration of Speech Channels
    Leshem, Rotem
    Icht, Michal
    Bentzur, Roni
    Ben-David, Boaz M.
    [J]. FRONTIERS IN PSYCHIATRY, 2020, 11
  • [29] The Contribution of Visual Articulatory Gestures and Orthography to Speech Processing: Evidence From Novel Word Learning
    Pattamadilok, Chotiga
    Welby, Pauline
    Tyler, Michael D.
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2022, 48 (10) : 1542 - 1558
  • [30] Evidence for children's online integration of simultaneous information from speech and iconic gestures: an ERP study
    Sekine, Kazuki
    Schoechl, Christina
    Mulder, Kimberley
    Holler, Judith
    Kelly, Spencer
    Furman, Reyhan
    Ozyurek, Asli
    [J]. LANGUAGE COGNITION AND NEUROSCIENCE, 2020, 35 (10) : 1283 - 1294