Bayesian computation in recurrent neural circuits

被引:157
|
作者
Rao, RPN [1 ]
机构
[1] Univ Washington, Dept Comp Sci & Engn, Seattle, WA 98195 USA
关键词
D O I
10.1162/08997660460733976
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A large number of human psychophysical results have been successfully explained in recent years using Bayesian models. However, the neural implementation of such models remains largely unclear. In this article, we show that a network architecture commonly used to model the cerebral cortex can implement Bayesian inference for an arbitrary hidden Markov model. We illustrate the approach using an orientation discrimination task and a visual motion detection task. In the case of orientation discrimination, we show that the model network can infer the posterior distribution over orientations and correctly estimate stimulus orientation in the presence of significant noise. In the case of motion detection, we show that the resulting model network exhibits direction selectivity and correctly computes the posterior probabilities over motion direction and position. When used to solve the well-known random dots motion discrimination task, the model generates responses that mimic the activities of evidence-accumulating neurons in cortical areas LIP and FEF. The framework we introduce posits a new interpretation of cortical activities in terms of log posterior probabilities of stimuli occurring in the natural world.
引用
收藏
页码:1 / 38
页数:38
相关论文
共 50 条
  • [21] A modular architecture for transparent computation in recurrent neural networks
    Carmantini, Giovanni S.
    Graben, Peter Beim
    Desroches, Mathieu
    Rodrigues, Serafim
    NEURAL NETWORKS, 2017, 85 : 85 - 105
  • [22] Residual dynamics resolves recurrent contributions to neural computation
    Galgali, Aniruddh R.
    Sahani, Maneesh
    Mante, Valerio
    NATURE NEUROSCIENCE, 2023, 26 (02) : 326 - +
  • [23] Pulse-based circuits and methods for probabilistic neural computation
    Astaras, A
    Dalzell, R
    Murray, A
    Reekie, M
    PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON MICROELECTRONICS FOR NEURAL, FUZZY AND BIO-INSPIRED SYSTEMS, MICORNEURO'99, 1999, : 96 - 102
  • [24] Nonlinear Bayesian Filters for Training Recurrent Neural Networks
    Arasaratnam, Ienkaran
    Haykin, Simon
    MICAI 2008: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2008, 5317 : 12 - 33
  • [25] Identification of Recurrent Neural Networks by Bayesian Interrogation Techniques
    Poczos, Barnabas
    Lorincz, Andras
    JOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10 : 515 - 554
  • [26] Identification of recurrent neural networks by bayesian interrogation techniques
    Department of Information Systems, Eötvös Loránd University, Pázmány P. sêtány 1/C, Budapest H-11117, Hungary
    J. Mach. Learn. Res., 2009, (515-554):
  • [27] Bayesian surprise shapes neural responses in somatosensory cortical circuits
    English, Gwendolyn
    Nejad, Newsha Ghasemi
    Sommerfelt, Marcel
    Yanik, Mehmet Fatih
    Von der Behrens, Wolfger
    CELL REPORTS, 2023, 42 (02):
  • [28] Convolutional Neural Networks as Summary Statistics for Approximate Bayesian Computation
    Akesson, Mattias
    Singh, Prashant
    Wrede, Fredrik
    Hellander, Andreas
    IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2022, 19 (06) : 3353 - 3365
  • [29] A reservoir of timescales emerges in recurrent circuits with heterogeneous neural assemblies
    Stern, Merav
    Istrate, Nicolae
    Mazzucato, Luca
    ELIFE, 2023, 12
  • [30] LightRNN: Memory and Computation-Efficient Recurrent Neural Networks
    Li, Xiang
    Qin, Tao
    Yang, Jian
    Liu, Tie-Yan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29