Sounds facilitate visual motion discrimination via the enhancement of late occipital visual representations

被引:33
|
作者
Kayser, Stephanie J. [1 ]
Philiastides, Marios G. [1 ]
Kayser, Christoph [1 ]
机构
[1] Univ Glasgow, Inst Neurosci & Psychol, Glasgow, Lanark, Scotland
基金
欧洲研究理事会; 英国生物技术与生命科学研究理事会;
关键词
Audio-visual; EEG; Single trial decoding; Sensory decision making; Motion discrimination; PERCEPTUAL DECISION-MAKING; ANTERIOR CINGULATE CORTEX; MULTISENSORY INTEGRATION; AUDITORY MOTION; AUDIOVISUAL MOTION; CUE INTEGRATION; EVIDENCE ACCUMULATION; LOW-LEVEL; OSCILLATIONS; SIGNALS;
D O I
10.1016/j.neuroimage.2017.01.010
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100 ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350 ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.
引用
收藏
页码:31 / 41
页数:11
相关论文
共 50 条
  • [41] RESPONSES OF INFANT MONKEYS TO PICTORIAL REPRESENTATIONS OF A LEARNED VISUAL DISCRIMINATION
    ZIMMERMAN, RR
    HOCHBERG, J
    PSYCHONOMIC SCIENCE, 1970, 18 (05): : 307 - 308
  • [42] Enhancement of visual cues to self-motion during a visual/vestibular conflict
    McManus, Meaghan
    Harris, Laurence R.
    PLOS ONE, 2023, 18 (03):
  • [43] A SPECIFIC AND ENDURING IMPROVEMENT IN VISUAL-MOTION DISCRIMINATION
    BALL, K
    SEKULER, R
    SCIENCE, 1982, 218 (4573) : 697 - 698
  • [44] Apparent motion enhances visual rhythm discrimination in infancy
    Brandon, Melissa
    Saffran, Jenny R.
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2011, 73 (04) : 1016 - 1020
  • [45] Confidence in visual motion discrimination is preserved in individuals with schizophrenia
    Faivre, Nathan
    Roger, Matthieu
    Pereira, Michael
    de Gardelle, Vincent
    Vergnaud, Jean-Christophe
    Passerieux, Christine
    Roux, Paul
    JOURNAL OF PSYCHIATRY & NEUROSCIENCE, 2021, 46 (01): : E65 - E73
  • [46] Initial scene representations facilitate eye movement guidance in visual search
    Castelhano, Monica S.
    Henderson, John M.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2007, 33 (04) : 753 - 763
  • [47] Auditory capture of visual motion: effects on perception and discrimination
    McCourt, Mark E.
    Leone, Lynnette M.
    NEUROREPORT, 2016, 27 (14) : 1095 - 1100
  • [48] Adaptive mechanisms of visual motion discrimination, integration, and segregation
    Penaloza, Boris
    Herzog, Michael H.
    Ogmen, Haluk
    VISION RESEARCH, 2021, 188 : 96 - 114
  • [49] The discrimination of abrupt changes in speed and direction of visual motion
    Mateeff, S
    Dimitrov, G
    Genova, B
    Likova, L
    Stefanova, M
    Hohnsbein, J
    VISION RESEARCH, 2000, 40 (04) : 409 - 415
  • [50] Apparent motion enhances visual rhythm discrimination in infancy
    Melissa Brandon
    Jenny R. Saffran
    Attention, Perception, & Psychophysics, 2011, 73 : 1016 - 1020