Neural integration of speech and gesture in schizophrenia: Evidence for differential processing of metaphoric gestures

被引:40
|
作者
Straube, Benjamin [1 ]
Green, Antonia [1 ]
Sass, Katharina [2 ,3 ]
Kirner-Veselinovic, Andre [2 ,3 ]
Kircher, Tilo [1 ]
机构
[1] Univ Marburg, Dept Psychiat & Psychotherapy, D-35039 Marburg, Germany
[2] Rhein Westfal TH Aachen, Dept Psychiat Psychotherapy & Psychosomat, Aachen, Germany
[3] JARA Translat Brain Med, Aachen, Germany
关键词
co-verbal gestures; metaphoric gestures; iconic gestures; integration; schizophrenia; PREFRONTAL CORTEX; EPISODIC MEMORY; HIPPOCAMPAL DYSFUNCTION; AUDIOVISUAL INTEGRATION; ICONIC GESTURES; BRAIN; COMPREHENSION; RECOGNITION; LANGUAGE; BEHAVIOR;
D O I
10.1002/hbm.22015
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Gestures are an important component of interpersonal communication. Especially, complex multimodal communication is assumed to be disrupted in patients with schizophrenia. In healthy subjects, differential neural integration processes for gestures in the context of concrete [iconic (IC) gestures] and abstract sentence contents [metaphoric (MP) gestures] had been demonstrated. With this study we wanted to investigate neural integration processes for both gesture types in patients with schizophrenia. During functional magnetic resonance imaging-data acquisition, 16 patients with schizophrenia (P) and a healthy control group (C) were shown videos of an actor performing IC and MP gestures and associated sentences. An isolated gesture (G) and isolated sentence condition (S) were included to separate unimodal from bimodal effects at the neural level. During IC conditions (IC > G IC > S) we found increased activity in the left posterior middle temporal gyrus (pMTG) in both groups. Whereas in the control group the left pMTG and the inferior frontal gyrus (IFG) were activated for the MP conditions (MP > G MP > S), no significant activation was found for the identical contrast in patients. The interaction of group (P/C) and gesture condition (MP/IC) revealed activation in the bilateral hippocampus, the left middle/superior temporal and IFG. Activation of the pMTG for the IC condition in both groups indicates intact neural integration of IC gestures in schizophrenia. However, failure to activate the left pMTG and IFG for MP co-verbal gestures suggests a disturbed integration of gestures embedded in an abstract sentence context. This study provides new insight into the neural integration of co-verbal gestures in patients with schizophrenia. Hum Brain Mapp, 2013. (c) 2012 Wiley Periodicals, Inc.
引用
收藏
页码:1696 / 1712
页数:17
相关论文
共 50 条
  • [1] Neural interaction of speech and gesture: Differential activations of metaphoric co-verbal gestures
    Kircher, Tilo
    Straube, Benjamin
    Leube, Dirk
    Weis, Susanne
    Sachs, Olga
    Willmes, Klaus
    Konrad, Kerstin
    Green, Antonia
    [J]. NEUROPSYCHOLOGIA, 2009, 47 (01) : 169 - 179
  • [2] The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech
    He, Yifei
    Nagels, Arne
    Schlesewsky, Matthias
    Straube, Benjamin
    [J]. FRONTIERS IN PSYCHOLOGY, 2018, 9
  • [3] Superior Temporal Sulcus Disconnectivity During Processing of Metaphoric Gestures in Schizophrenia
    Straube, Benjamin
    Green, Antonia
    Sass, Katharina
    Kircher, Tilo
    [J]. SCHIZOPHRENIA BULLETIN, 2014, 40 (04) : 936 - 944
  • [4] Gesture style can affect the integration of gestures and speech: the evidence from Chinese ERP research
    Sun, Fang
    Xiang, Huiwen
    Hu, Xinzhuo
    Li, Yutong
    Sui, Xue
    [J]. NEUROREPORT, 2020, 31 (12) : 885 - 890
  • [5] Gesture and the processing of speech: Neuropsychological evidence
    Hadar, U
    Wenkert-Olenik, D
    Krauss, R
    Soroker, N
    [J]. BRAIN AND LANGUAGE, 1998, 62 (01) : 107 - 126
  • [6] Do metaphoric gestures influence how a message is perceived? The effects of metaphoric gesture-speech matches and mismatches on semantic communication and social judgment
    Beattie, Geoffrey
    Sale, Laura
    [J]. SEMIOTICA, 2012, 192 : 77 - 98
  • [7] Neural correlates of the processing of co-speech gestures
    Holle, Henning
    Gunter, Thomas C.
    Rueschemeyer, Shirley-Ann
    Hennenlotter, Andreas
    Iacoboni, Marco
    [J]. NEUROIMAGE, 2008, 39 (04) : 2010 - 2024
  • [8] Multimodal speech-gesture training in patients with schizophrenia disorder: Effects on of life and neural processing
    Riedl, Lydia
    Nagels, Arne
    Sammer, Gebhard
    Choudhury, Momoko
    Nonnenmann, Annika
    Suetterlin, Anne
    Feise, Chiara
    Haslach, Maxi
    Bitsch, Florian
    Straube, Benjamin
    [J]. SCHIZOPHRENIA RESEARCH, 2022, 246 : 112 - 125
  • [9] Social cues, mentalizing and the neural processing of speech accompanied by gestures
    Straube, Benjamin
    Green, Antonia
    Jansen, Andreas
    Chatterjee, Anjan
    Kircher, Tilo
    [J]. NEUROPSYCHOLOGIA, 2010, 48 (02) : 382 - 393
  • [10] The role of the left and right inferior frontal gyrus in processing metaphoric and unrelated co-speech gestures
    Steines, Miriam
    Nagels, Arne
    Kircher, Tilo
    Straube, Benjamin
    [J]. NEUROIMAGE, 2021, 237