Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition

被引:174
|
作者
Stevenson, Ryan A. [1 ]
James, Thomas W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
关键词
Multisensory integration; Vision; Superadditivity; Perception; fMRI; Neuroimaging; Auditory; Speech perception; MULTISENSORY INTEGRATION; COLLICULUS NEURONS; PERCEPTION; ACTIVATION; CORTEX; FMRI; ORGANIZATION; BRAIN; EYE; DETERMINANTS;
D O I
10.1016/j.neuroimage.2008.09.034
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The superior temporal sulcus (STS) is a region involved in audiovisual integration. In non-human primates, multisensory neurons in STS display inverse effectiveness. In two fMRI studies using multisensory tool and speech stimuli presented at parametrically varied levels of signal strength, we show that the pattern of neural activation in human STS is also inversely effective. Although multisensory tool-defined and speechdefined regions of interest were non-overlapping, the pattern of inverse effectiveness was the same for tools and speech across regions. The findings suggest that, even though there are sub-regions in STS that are speech-selective, the manner in which visual and auditory signals are integrated in multisensory STS is not specific to speech. (C) 2008 Elsevier Inc. All rights reserved.
引用
收藏
页码:1210 / 1223
页数:14
相关论文
共 32 条
  • [21] A Double Dissociation between Anterior and Posterior Superior Temporal Gyrus for Processing Audiovisual Speech Demonstrated by Electrocorticography
    Ozker, Muge
    Schepers, Inga M.
    Magnotti, John F.
    Yoshor, Daniel
    Beauchamp, Michael S.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2017, 29 (06) : 1044 - 1060
  • [22] Noise alters beta-band activity in superior temporal cortex during audiovisual speech processing
    Schepers, Inga M.
    Schneider, Till R.
    Hipp, Joerg F.
    Engel, Andreas K.
    Senkowski, Daniel
    NEUROIMAGE, 2013, 70 : 101 - 112
  • [23] Human behavioural discrimination of human, chimpanzee and macaque affective vocalisations is reflected by the neural response in the superior temporal sulcus
    Fritz, Thomas
    Mueller, Karsten
    Guha, Anika
    Gouws, Andre
    Levita, Liat
    Andrews, Timothy J.
    Slocombe, Katie E.
    NEUROPSYCHOLOGIA, 2018, 111 : 145 - 150
  • [24] Dissociated Roles of the Inferior Frontal Gyrus and Superior Temporal Sulcus in Audiovisual Processing: Top-Down and Bottom-Up Mismatch Detection
    Uno, Takeshi
    Kawai, Kensuke
    Sakai, Katsuyuki
    Wakebe, Toshihiro
    Ibaraki, Takuya
    Kunii, Naoto
    Matsuo, Takeshi
    Saito, Nobuhito
    PLOS ONE, 2015, 10 (03):
  • [25] Functional organization of face processing in the human superior temporal sulcus: a 7T high-resolution fMRI study
    Schobert, Anne-Kathrin
    Corradi-Dell'Acqua, Corrado
    Fruhholz, Sascha
    van der Zwaag, Wietske
    Vuilleumier, Patrik
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2018, 13 (01) : 102 - 113
  • [26] SELECTIVELY DISTRIBUTED-PROCESSING OF VISUAL OBJECT RECOGNITION IN THE TEMPORAL AND FRONTAL LOBES OF THE HUMAN BRAIN
    SEECK, M
    SCHOMER, D
    MAINWARING, N
    IVES, J
    DUBUISSON, D
    BLUME, H
    COSGROVE, R
    RANSIL, BJ
    MESULAM, MM
    ANNALS OF NEUROLOGY, 1995, 37 (04) : 538 - 545
  • [27] Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice- and face-sensitive regions in the superior temporal sulcus
    Kreifelts, Benjamin
    Ethofer, Thomas
    Shiozawa, Thomas
    Grodd, Wolfgang
    Wildgruber, Dirk
    NEUROPSYCHOLOGIA, 2009, 47 (14) : 3059 - 3066
  • [28] Human EEG and Recurrent Neural Networks Exhibit Common Temporal Dynamics During Speech Recognition
    Hashemnia, Saeedeh
    Grasse, Lukas
    Soni, Shweta
    Tata, Matthew S.
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2021, 15
  • [29] Integration of Industrially-Oriented Human-Robot Speech Communication and Vision-Based Object Recognition
    Rogowski, Adam
    Bieliszczuk, Krzysztof
    Rapcewicz, Jerzy
    SENSORS, 2020, 20 (24) : 1 - 22
  • [30] Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence
    Radoslaw Martin Cichy
    Aditya Khosla
    Dimitrios Pantazis
    Antonio Torralba
    Aude Oliva
    Scientific Reports, 6