Modeling cross-modal enhancement and modality-specific suppression in multisensory neurons

被引:35
|
作者
Patton, PE [1 ]
Anastasio, TJ
机构
[1] Univ Illinois, Beckman Inst, Urbana, IL 61801 USA
[2] Univ Illinois, Dept Mol & Integrat Physiol, Urbana, IL 61801 USA
关键词
D O I
10.1162/08997660360581903
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cross-modal enhancement (CME) occurs when the neural response to a stimulus of one modality is augmented by another stimulus of a different modality. Paired stimuli of the same modality never produce supra-additive enhancement but may produce modality-specific suppression (MSS), in which the response to a stimulus of one modality is diminished by another stimulus of the same modality. Both CME and MSS have been described for neurons in the deep layers of the superior colliculus (DSC), but their neural mechanisms remain unknown. Previous investigators have suggested that CME involves a multiplicative amplifier, perhaps mediated by N-methyl D-aspartate (NMDA) receptors, which is engaged by cross-modal but not modality-specific input. We previously postulated that DSC neurons use multisensory input to compute the posterior probability of a target using Bayes' rule. The Bayes' rule model reproduces the major features of CME. Here we use simple neural implementations of our model to simulate both CME and MSS and to argue that multiplicative processes are not needed for CME, but may be needed to represent input variance and covariance. Producing CME requires only weighted summation of inputs and the threshold and saturation properties of simple models of biological neurons. Multiplicative nodes allow accurate computation of posterior target probabilities when the spontaneous and driven inputs have unequal variances and covariances. Neural implementations of the Bayes' rule model account better than the multiplicative amplifier hypothesis for the effects of pharmacological blockade of NMDA receptors on the multisensory responses of DSC neurons. The neural implementations also account for MSS, given only the added hypothesis that input channels of the same modality have more spontaneous covariance than those of different modalities.
引用
收藏
页码:783 / 810
页数:28
相关论文
共 50 条
  • [1] Adaptation in multisensory neurons: Impact on cross-modal enhancement
    Elliott, Terry
    Kuang, Xutao
    Shadbolt, Nigel R.
    Zauner, Klaus-Peter
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2009, 20 (01) : 1 - 31
  • [2] Modality-specific matrix factorization hashing for cross-modal retrieval
    Haixia Xiong
    Weihua Ou
    Zengxian Yan
    Jianping Gou
    Quan Zhou
    Anzhi Wang
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2022, 13 : 5067 - 5081
  • [3] Modality-specific Adaptive Scaling Method for Cross-modal Retrieval
    Chen, Baitao
    Ke, Xiao
    [J]. 2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 202 - 205
  • [4] MODALITY-SPECIFIC STRUCTURE PRESERVING HASHING FOR CROSS-MODAL RETRIEVAL
    Liu, Xingbo
    Nie, Xiushan
    Sun, Haoliang
    Cui, Chaoran
    Yin, Yilong
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1678 - 1682
  • [5] Cross-modal deactivations during modality-specific selective attention
    Mozolic, Jennifer L.
    Joyner, David
    Hugenschmidt, Christina E.
    Peiffer, Ann M.
    Kraft, Robert A.
    Maldjian, Joseph A.
    Laurienti, Paul J.
    [J]. BMC NEUROLOGY, 2008, 8 (1)
  • [6] Modality-specific matrix factorization hashing for cross-modal retrieval
    Xiong, Haixia
    Ou, Weihua
    Yan, Zengxian
    Gou, Jianping
    Zhou, Quan
    Wang, Anzhi
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 13 (11) : 5067 - 5081
  • [7] Cross-modal deactivations during modality-specific selective attention
    Jennifer L Mozolic
    David Joyner
    Christina E Hugenschmidt
    Ann M Peiffer
    Robert A Kraft
    Joseph A Maldjian
    Paul J Laurienti
    [J]. BMC Neurology, 8
  • [8] Modality-specific and shared generative adversarial network for cross-modal retrieval
    Wu, Fei
    Jing, Xiao-Yuan
    Wu, Zhiyong
    Ji, Yimu
    Dong, Xiwei
    Luo, Xiaokai
    Huang, Qinghua
    Wang, Ruchuan
    [J]. PATTERN RECOGNITION, 2020, 104
  • [9] Modality-Specific Cross-Modal Similarity Measurement With Recurrent Attention Network
    Peng, Yuxin
    Qi, Jinwei
    Yuan, Yuxin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) : 5585 - 5599
  • [10] Cross-modal and modality-specific expectancy effects between pain and disgust
    Sharvit, Gil
    Vuilleumier, Patrik
    Delplanque, Sylvain
    Corradi-Dell'Acqua, Corrado
    [J]. SCIENTIFIC REPORTS, 2015, 5