Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations

被引:33
|
作者
Kayser, Stephanie J. [1 ]
Philiastides, Marios G. [1 ]
Kayser, Christoph [1 ]
机构
[1] Univ Glasgow, Inst Neurosci & Psychol, Glasgow, Lanark, Scotland
基金
欧洲研究理事会; 英国生物技术与生命科学研究理事会;
关键词
Audio-visual; EEG; Single trial decoding; Sensory decision making; Motion discrimination; PERCEPTUAL DECISION-MAKING; ANTERIOR CINGULATE CORTEX; MULTISENSORY INTEGRATION; AUDITORY MOTION; AUDIOVISUAL MOTION; CUE INTEGRATION; EVIDENCE ACCUMULATION; LOW-LEVEL; OSCILLATIONS; SIGNALS;
D O I
10.1016/j.neuroimage.2017.01.010
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100 ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350 ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.
引用
收藏
页码:31 / 41
页数:11
相关论文
共 50 条
  • [31] Unseen fearful faces facilitate visual discrimination in the intact field
    Bertini, Caterina
    Cecere, Roberto
    Ladavas, Elisabetta
    NEUROPSYCHOLOGIA, 2019, 128 : 58 - 64
  • [32] From symbols to sounds:: Visual symbolic information activates sound representations
    Widmann, A
    Kujala, T
    Tervaniemi, M
    Kujala, A
    Schröger, E
    PSYCHOPHYSIOLOGY, 2004, 41 (05) : 709 - 715
  • [33] Changing Pitch of Sounds Alters Perceived Visual Motion Trajectory
    Takeshima, Yasuhiro
    Gyoba, Jiro
    MULTISENSORY RESEARCH, 2013, 26 (04) : 317 - 332
  • [34] Noise Improves Visual Motion Discrimination via a Stochastic Resonance-Like Phenomenon
    Trevino, Mario
    De la Torre-Valdovinos, Braniff
    Manjarrez, Elias
    FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
  • [35] Analysis of heart sounds using time-frequency visual representations
    Seshadri, N. P. Guhan
    Geethanjali, B.
    Kumar, S. Pravin
    INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2016, 21 (03) : 205 - 228
  • [36] Spatially uninformative sounds increase sensitivity for visual motion change
    Sabine M. Staufenbiel
    Rob H. J. van der Lubbe
    Durk Talsma
    Experimental Brain Research, 2011, 213 : 457 - 464
  • [37] Enabling Visual Object Detection With Object Sounds via Visual Modality Recalling Memory
    Kim, Jung Uk
    Ro, Yong Man
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 341 - 353
  • [38] Spatially uninformative sounds increase sensitivity for visual motion change
    Staufenbiel, Sabine M.
    van der Lubbe, Rob H. J.
    Talsma, Durk
    EXPERIMENTAL BRAIN RESEARCH, 2011, 213 (04) : 457 - 464
  • [39] Enabling Visual Object Detection With Object Sounds via Visual Modality Recalling Memory
    Kim, Jung Uk
    Ro, Yong Man
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 341 - 353
  • [40] Visual tracking via Boolean map representations
    Zhang, Kaihua
    Liu, Qingshan
    Yang, Jian
    Yang, Ming-Hsuan
    PATTERN RECOGNITION, 2018, 81 : 147 - 160