Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition

被引:174
|
作者
Stevenson, Ryan A. [1 ]
James, Thomas W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
关键词
Multisensory integration; Vision; Superadditivity; Perception; fMRI; Neuroimaging; Auditory; Speech perception; MULTISENSORY INTEGRATION; COLLICULUS NEURONS; PERCEPTION; ACTIVATION; CORTEX; FMRI; ORGANIZATION; BRAIN; EYE; DETERMINANTS;
D O I
10.1016/j.neuroimage.2008.09.034
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The superior temporal sulcus (STS) is a region involved in audiovisual integration. In non-human primates, multisensory neurons in STS display inverse effectiveness. In two fMRI studies using multisensory tool and speech stimuli presented at parametrically varied levels of signal strength, we show that the pattern of neural activation in human STS is also inversely effective. Although multisensory tool-defined and speechdefined regions of interest were non-overlapping, the pattern of inverse effectiveness was the same for tools and speech across regions. The findings suggest that, even though there are sub-regions in STS that are speech-selective, the manner in which visual and auditory signals are integrated in multisensory STS is not specific to speech. (C) 2008 Elsevier Inc. All rights reserved.
引用
收藏
页码:1210 / 1223
页数:14
相关论文
共 32 条
  • [31] Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence
    Cichy, Radoslaw Martin
    Khosla, Aditya
    Pantazis, Dimitrios
    Torralba, Antonio
    Oliva, Aude
    SCIENTIFIC REPORTS, 2016, 6
  • [32] Exploiting Spatio-temporal Human-object Relations using Graph Neural Networks for Human Action Recognition and 3D Motion Forecasting
    Lagamtzis, Dimitrios
    Schmidt, Fabian
    Seyler, Jan
    Dang, Thao
    Schober, Steffen
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7832 - 7838