Bayesian computation in recurrent neural circuits

被引:157
|
作者
Rao, RPN [1 ]
机构
[1] Univ Washington, Dept Comp Sci & Engn, Seattle, WA 98195 USA
关键词
D O I
10.1162/08997660460733976
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A large number of human psychophysical results have been successfully explained in recent years using Bayesian models. However, the neural implementation of such models remains largely unclear. In this article, we show that a network architecture commonly used to model the cerebral cortex can implement Bayesian inference for an arbitrary hidden Markov model. We illustrate the approach using an orientation discrimination task and a visual motion detection task. In the case of orientation discrimination, we show that the model network can infer the posterior distribution over orientations and correctly estimate stimulus orientation in the presence of significant noise. In the case of motion detection, we show that the resulting model network exhibits direction selectivity and correctly computes the posterior probabilities over motion direction and position. When used to solve the well-known random dots motion discrimination task, the model generates responses that mimic the activities of evidence-accumulating neurons in cortical areas LIP and FEF. The framework we introduce posits a new interpretation of cortical activities in terms of log posterior probabilities of stimuli occurring in the natural world.
引用
收藏
页码:1 / 38
页数:38
相关论文
共 50 条
  • [1] A Bayesian constraint on neural computation
    Levy, William B.
    2006 IEEE International Symposium on Information Theory, Vols 1-6, Proceedings, 2006, : 655 - 658
  • [2] Recurrent neural networks for music computation
    Franklin, Judy A.
    INFORMS JOURNAL ON COMPUTING, 2006, 18 (03) : 321 - 338
  • [3] Sparse Bayesian Recurrent Neural Networks
    Chatzis, Sotirios P.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2015, PT II, 2015, 9285 : 359 - 372
  • [4] Bayesian learning for recurrent neural networks
    Crucianu, M
    Boné, R
    de Beauville, JPA
    NEUROCOMPUTING, 2001, 36 (01) : 235 - 242
  • [5] Dynamic Bayesian networks for integrated neural computation
    Labatut, V
    Pastor, J
    1ST INTERNATIONAL IEEE EMBS CONFERENCE ON NEURAL ENGINEERING 2003, CONFERENCE PROCEEDINGS, 2003, : 537 - 540
  • [6] Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks
    Bitzer, Sebastian
    Kiebel, Stefan J.
    BIOLOGICAL CYBERNETICS, 2012, 106 (4-5) : 201 - 217
  • [7] Recognizing recurrent neural networks (rRNN): Bayesian inference for recurrent neural networks
    Sebastian Bitzer
    Stefan J. Kiebel
    Biological Cybernetics, 2012, 106 : 201 - 217
  • [8] Decorrelation by Recurrent Inhibition in Heterogeneous Neural Circuits
    Bernacchia, Alberto
    Wang, Xiao-Jing
    NEURAL COMPUTATION, 2013, 25 (07) : 1732 - 1767
  • [9] Multiscale computation on feedforward neural network and recurrent neural network
    Bin Li
    Xiaoying Zhuang
    Frontiers of Structural and Civil Engineering, 2020, 14 : 1285 - 1298
  • [10] Fast computation with spikes in a recurrent neural network
    Jin, DHZ
    Seung, S
    PHYSICAL REVIEW E, 2002, 65 (05):