Perceived communicative intent in gesture and language modulates the superior temporal sulcus

被引:32
|
作者
Redcay, Elizabeth [1 ]
Velnoskey, Kayla R. [1 ]
Rowe, Meredith L. [2 ]
机构
[1] Univ Maryland, Dept Psychol, College Pk, MD 20742 USA
[2] Harvard Univ, Grad Sch Educ, Cambridge, MA 02138 USA
关键词
social perception; sentence processing; communication; second-person neuroscience; semantics; functional MRI; surface analyses; HUMAN CEREBRAL-CORTEX; CO-SPEECH GESTURES; SOCIAL-PERCEPTION; HUMAN BRAIN; FMRI; ORGANIZATION; COGNITION; INTEGRATION; REGIONS; SYSTEM;
D O I
10.1002/hbm.23251
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Behavioral evidence and theory suggest gesture and language processing may be part of a shared cognitive system for communication. While much research demonstrates both gesture and language recruit regions along perisylvian cortex, relatively less work has tested functional segregation within these regions on an individual level. Additionally, while most work has focused on a shared semantic network, less has examined shared regions for processing communicative intent. To address these questions, functional and structural MRI data were collected from 24 adult participants while viewing videos of an experimenter producing communicative, Participant-Directed Gestures (PDG) (e.g., Hello, come here), noncommunicative Self-adaptor Gestures (SG) (e.g., smoothing hair), and three written text conditions: (1) Participant-Directed Sentences (PDS), matched in content to PDG, (2) Third-person Sentences (3PS), describing a character's actions from a third-person perspective, and (3) meaningless sentences, Jabberwocky (JW). Surface-based conjunction and individual functional region of interest analyses identified shared neural activation between gesture (PDGvsSG) and language processing using two different language contrasts. Conjunction analyses of gesture (PDGvsSG) and Third-person Sentences versus Jabberwocky revealed overlap within left anterior and posterior superior temporal sulcus (STS). Conjunction analyses of gesture and Participant-Directed Sentences to Third-person Sentences revealed regions sensitive to communicative intent, including the left middle and posterior STS and left inferior frontal gyrus. Further, parametric modulation using participants' ratings of stimuli revealed sensitivity of left posterior STS to individual perceptions of communicative intent in gesture. These data highlight an important role of the STS in processing participant-directed communicative intent through gesture and language. Hum Brain Mapp 37:3444-3461, 2016. (c) 2016 Wiley Periodicals, Inc.
引用
收藏
页码:3444 / 3461
页数:18
相关论文
共 50 条
  • [1] The Superior Temporal Sulcus Differentiates Communicative and Noncommunicative Auditory Signals
    Shultz, Sarah
    Vouloumanos, Athena
    Pelphrey, Kevin
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2012, 24 (05) : 1224 - 1232
  • [2] Processing communicative facial and vocal cues in the superior temporal sulcus
    Deen, Ben
    Saxe, Rebecca
    Kanwisher, Nancy
    [J]. NEUROIMAGE, 2020, 221
  • [3] Convergence of spoken and written language processing in the superior temporal sulcus
    Wilson, Stephen M.
    Bautista, Alexa
    McCarron, Angelica
    [J]. NEUROIMAGE, 2018, 171 : 62 - 74
  • [4] The Impact of Vascular Factors on Language Localization in the Superior Temporal Sulcus
    Wilson, Stephen M.
    [J]. HUMAN BRAIN MAPPING, 2014, 35 (08) : 4049 - 4063
  • [5] The connectivity signature of co-speech gesture integration: The superior temporal sulcus modulates connectivity between areas related to visual gesture and auditory speech processing
    Straube, Benjamin
    Wroblewski, Adrian
    Jansen, Andreas
    He, Yifei
    [J]. NEUROIMAGE, 2018, 181 : 539 - 549
  • [6] Attention to emotion modulates fMRI activity in human right superior temporal sulcus
    Narumoto, J
    Okada, T
    Sadato, N
    Fukui, K
    Yonekura, Y
    [J]. COGNITIVE BRAIN RESEARCH, 2001, 12 (02): : 225 - 231
  • [7] Parts-based representations of perceived face movements in the superior temporal sulcus
    Deen, Ben
    Saxe, Rebecca
    [J]. HUMAN BRAIN MAPPING, 2019, 40 (08) : 2499 - 2510
  • [8] Posterior Superior Temporal Sulcus Responses Predict Perceived Pleasantness of Skin Stroking
    Davidovic, Monika
    Jonsson, Emma H.
    Olausson, Hakan
    Bjornsdotter, Malin
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
  • [9] Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices
    Noesselt, Toemme
    Rieger, Jochem W.
    Schoenfeld, Mircea Ariel
    Kanowski, Martin
    Hinrichs, Hermann
    Heinze, Hans-Jochen
    Driver, Jon
    [J]. JOURNAL OF NEUROSCIENCE, 2007, 27 (42): : 11431 - 11441
  • [10] Temporal alignment of communicative gesture sequences
    Heloir, Alexis
    Courty, Nicolas
    Gibet, Syvie
    Multon, Franck
    [J]. COMPUTER ANIMATION AND VIRTUAL WORLDS, 2006, 17 (3-4) : 347 - 357