Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations

被引:33
|
作者
Kayser, Stephanie J. [1 ]
Philiastides, Marios G. [1 ]
Kayser, Christoph [1 ]
机构
[1] Univ Glasgow, Inst Neurosci & Psychol, Glasgow, Lanark, Scotland
基金
欧洲研究理事会; 英国生物技术与生命科学研究理事会;
关键词
Audio-visual; EEG; Single trial decoding; Sensory decision making; Motion discrimination; PERCEPTUAL DECISION-MAKING; ANTERIOR CINGULATE CORTEX; MULTISENSORY INTEGRATION; AUDITORY MOTION; AUDIOVISUAL MOTION; CUE INTEGRATION; EVIDENCE ACCUMULATION; LOW-LEVEL; OSCILLATIONS; SIGNALS;
D O I
10.1016/j.neuroimage.2017.01.010
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100 ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350 ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.
引用
收藏
页码:31 / 41
页数:11
相关论文
共 50 条
  • [11] Bioinspired figure-ground discrimination via visual motion smoothing
    Wu, Zhihua
    Guo, Aike
    PLOS COMPUTATIONAL BIOLOGY, 2023, 19 (04)
  • [12] TIMING OF VISUAL EVENTS FOR MOTION DISCRIMINATION
    ALLIK, J
    PULVER, A
    VISION RESEARCH, 1994, 34 (12) : 1585 - 1594
  • [13] Pedestal effect in visual motion discrimination
    Journal of the Optical Society of America A: Optics and Image Science, and Vision, 1995, 12 (12):
  • [14] Visual motion transforms visual space representations similarly throughout the human visual hierarchy
    Harvey, Ben M.
    Dumoulin, Serge O.
    NEUROIMAGE, 2016, 127 : 173 - 185
  • [15] VISUAL-DISCRIMINATION DEFECTS IN CATS WITH TEMPORAL OR OCCIPITAL DECORTICATIONS
    CORNWELL, P
    WARREN, JM
    JOURNAL OF COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1981, 95 (04): : 603 - 614
  • [16] Visual motion perception induced by sounds in vertical plane
    Teramoto, Wataru
    Manaka, Yuko
    Hidaka, Souta
    Sugita, Yoichi
    Miyauchi, Ryota
    Sakamoto, Shuichi
    Gyoba, Jiro
    Iwaya, Yukio
    Suzuki, Yoiti
    NEUROSCIENCE LETTERS, 2010, 479 (03) : 221 - 225
  • [17] LATENCY PHENOMENA IN PROLONGED LEARNING OF VISUAL REPRESENTATIONS OF RUSSIAN SOUNDS
    CROTHERS, E
    SUPPES, P
    WEIR, R
    IRAL-INTERNATIONAL REVIEW OF APPLIED LINGUISTICS IN LANGUAGE TEACHING, 1964, 2 (03): : 205 - 217
  • [18] Unexpected Sounds Nonselectively Inhibit Active Visual Stimulus Representations
    Soh, Cheol
    Wessel, Jan R.
    CEREBRAL CORTEX, 2021, 31 (03) : 1632 - 1646
  • [19] Effects of the alternation of sounds on the perceived direction of visual motion
    Teramoto, W.
    Hidaka, S.
    Sugita, Y.
    Sakamoto, S.
    Gyoba, J.
    Iwaya, Y.
    Suzuki, Y.
    PERCEPTION, 2010, 39 : 143 - 143
  • [20] Dissociating representations of affect and motion in visual cortices
    Kryklywy, James H.
    Forys, Brandon J.
    Vieira, Joana B.
    Quinlan, Derek J.
    Mitchell, Derek G. V.
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2023, 23 (05) : 1322 - 1345