Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100 ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350 ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.
机构:
Soochow Univ, Sch Educ, Dept Psychol, Suzhou 215123, Peoples R China
Univ Calif San Diego, Dept Neurosci, La Jolla, CA 92093 USASoochow Univ, Sch Educ, Dept Psychol, Suzhou 215123, Peoples R China
Feng, Wenfeng
Stoermer, Viola S.
论文数: 0引用数: 0
h-index: 0
机构:
Harvard Univ, Vis Sci Lab, Cambridge, MA 02138 USASoochow Univ, Sch Educ, Dept Psychol, Suzhou 215123, Peoples R China
Stoermer, Viola S.
Martinez, Antigona
论文数: 0引用数: 0
h-index: 0
机构:
Univ Calif San Diego, Dept Neurosci, La Jolla, CA 92093 USA
Nathan S Kline Inst Psychiat Res, Orangeburg, NY 10962 USASoochow Univ, Sch Educ, Dept Psychol, Suzhou 215123, Peoples R China
Martinez, Antigona
McDonald, John J.
论文数: 0引用数: 0
h-index: 0
机构:
Simon Fraser Univ, Dept Psychol, Burnaby, BC V5A IS6, CanadaSoochow Univ, Sch Educ, Dept Psychol, Suzhou 215123, Peoples R China
McDonald, John J.
Hillyard, Steven A.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Calif San Diego, Dept Neurosci, La Jolla, CA 92093 USASoochow Univ, Sch Educ, Dept Psychol, Suzhou 215123, Peoples R China
Hillyard, Steven A.
JOURNAL OF NEUROSCIENCE,
2014,
34
(29):
: 9817
-
9824
机构:
Alma Mater Studiorum Univ Bologna, Ctr Studi & Ric Neurosci Cognit, CsrNC, I-47521 Cesena, Italy
Alma Mater Studiorum Univ Bologna, Dipartimento Psicol, I-40127 Bologna, ItalyAlma Mater Studiorum Univ Bologna, Ctr Studi & Ric Neurosci Cognit, CsrNC, I-47521 Cesena, Italy
机构:
Tohoku Univ, Res Inst Elect Commun, Aoba Ku, Sendai, Miyagi 9808577, JapanTohoku Univ, Res Inst Elect Commun, Aoba Ku, Sendai, Miyagi 9808577, Japan
Kobayashi, Maori
论文数: 引用数:
h-index:
机构:
Teramoto, Wataru
Hidaka, Souta
论文数: 0引用数: 0
h-index: 0
机构:
Rikkyo Univ, Dept Psychol, Niiza, Saitama 3528558, JapanTohoku Univ, Res Inst Elect Commun, Aoba Ku, Sendai, Miyagi 9808577, Japan
Hidaka, Souta
Sugita, Yoichi
论文数: 0引用数: 0
h-index: 0
机构:
Waseda Univ, Dept Psychol, Shinjuku Ku, Toyama 1628644, JapanTohoku Univ, Res Inst Elect Commun, Aoba Ku, Sendai, Miyagi 9808577, Japan