Predictive coding of visual-auditory and motor-auditory events: An electrophysiological study

被引:19
|
作者
Stekelenburg, Jeroen J. [1 ]
Vroomen, Jean [1 ]
机构
[1] Tilburg Univ, Dept Cognit Neuropsychol, NL-5000 LE Tilburg, Netherlands
关键词
Predictive coding; Stimulus omission; Visual-auditory; Motor-auditory; Event-related potentials; MULTISENSORY INTERACTIONS; SPEECH; CORTEX; INTEGRATION; CONFLICT; NEGATIVITY; ACTIVATION; OMISSIONS; RESPONSES; MMN;
D O I
10.1016/j.brainres.2015.01.036
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The amplitude of auditory components of the event-related potential (ER?) is attenuated when sounds are self-generated compared to externally generated sounds. This effect has been ascribed to internal forward modals predicting the sensory consequences of one's own motor actions. Auditory potentials are also attenuated when a sound is accompanied by a video of anticipatory visual motion that reliably predicts the sound. Here, we investigated whether the neural underpinnings of prediction of upcoming auditory stimuli are similar for motor-auditory (MA) and visual-auditory (VA) events using a stimulus omission paradigm. In the MA condition, a finger tap triggered the sound of a handclap whereas in the VA condition the same sound was accompanied by a video showing the handclap. In both conditions, the auditory stimulus was omitted in either 50% or 12% of the trials. These auditory omissions induced early and mid-latency ERP components (oN1 and oN2, presumably reflecting prediction and prediction error), and subsequent higher-order error evaluation processes. The oN1 and oN2 of MA and VA were alike in amplitude, topography, and neural sources despite that the origin of the prediction stems from different brain areas (motor versus visual cortex). This suggests that MA and VA predictions activate a sensory template of the sound in auditory cortex. This article is part of a Special Issue entitled SI: Prediction and Attention. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:88 / 96
页数:9
相关论文
共 50 条
  • [41] Effects of Visual-Auditory Incongruity on Product Expression and Surprise
    Ludden, Geke D. S.
    Schifferstein, Hendrik N. J.
    INTERNATIONAL JOURNAL OF DESIGN, 2007, 1 (03): : 29 - 39
  • [42] Multisensory enhancement of localization with synergetic visual-auditory cues
    Godfroy, Martine
    Roumes, Corinne
    PROCEEDINGS OF THE TWENTY-SIXTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, 2004, : 470 - 475
  • [43] Visually Evoked Visual-Auditory Changes Associated with Auditory Performance in Children with Cochlear Implants
    Liang, Maojin
    Zhang, Junpeng
    Liu, Jiahao
    Chen, Yuebo
    Cai, Yuexin
    Wang, Xianjun
    Wang, Junbo
    Zhang, Xueyuan
    Chen, Suijun
    Li, Xianghui
    Chen, Ling
    Zheng, Yiqing
    FRONTIERS IN HUMAN NEUROSCIENCE, 2017, 11
  • [44] Optical imaging of visual-auditory multimodal fields in the guinea-pig auditory cortex
    Hobara, Keigo
    Yamada, Shinya
    Sugimoto, Shunji
    Horikawa, Junsei
    NEUROSCIENCE RESEARCH, 2009, 65 : S209 - S209
  • [45] ACQUISITION OF VISUAL-AUDITORY ASSOCIATIONS BY GOOD AND EXCELLENT READERS
    BARTHOLOMEUS, BN
    DOEHRING, DG
    PERCEPTUAL AND MOTOR SKILLS, 1972, 35 (03) : 847 - 855
  • [46] Spatial characteristics of visual-auditory summation in human saccades
    Hughes, HC
    Nelson, MD
    Aronchick, DM
    VISION RESEARCH, 1998, 38 (24) : 3955 - 3963
  • [47] DISCREPANCY AND NONDISCREPANCY METHODS OF ASSESSING VISUAL-AUDITORY INTERACTION
    WARREN, DH
    MCCARTHY, TJ
    WELCH, RB
    PERCEPTION & PSYCHOPHYSICS, 1983, 33 (05): : 413 - 419
  • [48] Experimental formation of visual-auditory associations on phoneme recognition
    Aleksandrov A.A.
    Dmitrieva E.S.
    Stankevich L.N.
    Neuroscience and Behavioral Physiology, 2010, 40 (9) : 998 - 1002
  • [49] Mechanisms of Visual-auditory Temporal Processing for Artificial Intelligence
    Yang, Jingjing
    Li, Qi
    Li, Xiujun
    Wu, Jinglong
    2014 7TH INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS (BMEI 2014), 2014, : 724 - 728
  • [50] Implicit perceptual learning of visual-auditory modality sequences
    Koch, Iring
    Blotenberg, Iris
    Fedosejew, Viktoria
    Stephan, Denise N.
    ACTA PSYCHOLOGICA, 2020, 202