Bayesian computation in recurrent neural circuits

被引:157
|
作者
Rao, RPN [1 ]
机构
[1] Univ Washington, Dept Comp Sci & Engn, Seattle, WA 98195 USA
关键词
D O I
10.1162/08997660460733976
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A large number of human psychophysical results have been successfully explained in recent years using Bayesian models. However, the neural implementation of such models remains largely unclear. In this article, we show that a network architecture commonly used to model the cerebral cortex can implement Bayesian inference for an arbitrary hidden Markov model. We illustrate the approach using an orientation discrimination task and a visual motion detection task. In the case of orientation discrimination, we show that the model network can infer the posterior distribution over orientations and correctly estimate stimulus orientation in the presence of significant noise. In the case of motion detection, we show that the resulting model network exhibits direction selectivity and correctly computes the posterior probabilities over motion direction and position. When used to solve the well-known random dots motion discrimination task, the model generates responses that mimic the activities of evidence-accumulating neurons in cortical areas LIP and FEF. The framework we introduce posits a new interpretation of cortical activities in terms of log posterior probabilities of stimuli occurring in the natural world.
引用
收藏
页码:1 / 38
页数:38
相关论文
共 50 条
  • [41] Rapid Bayesian Learning for Recurrent Neural Network Language Model
    Chien, Jen-Tzung
    Ku, Yuan-Chu
    Huang, Mou-Yue
    2014 9TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2014, : 34 - 38
  • [42] Fault detection and identification using Bayesian recurrent neural networks
    Sun, Weike
    Paiva, Antonio R. C.
    Xu, Peng
    Sundaram, Anantha
    Braatz, Richard D.
    COMPUTERS & CHEMICAL ENGINEERING, 2020, 141
  • [43] Modeling Geomagnetospheric Disturbances with Sequential Bayesian Recurrent Neural Networks
    Ouarbya, Lahcen
    Mirikitani, Derrick T.
    NEURAL INFORMATION PROCESSING, PT 1, PROCEEDINGS, 2009, 5863 : 91 - 99
  • [44] Scalable Bayesian Learning of Recurrent Neural Networks for Language Modeling
    Gan, Zhe
    Li, Chunyuan
    Chen, Changyou
    Pu, Yunchen
    Su, Qinliang
    Carin, Lawrence
    PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 321 - 331
  • [45] Learning and Processing the Ordinal Information of Temporal Sequences in Recurrent Neural Circuits
    Zou, Xiaolong
    Chu, Zhikun
    Guo, Qinghai
    Cheng, Jie
    Hong, Bo
    Wu, Si
    Mi, Yuanyuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [46] Dynamical complexity and computation in recurrent neural networks beyond their fixed point
    Bicky A. Marquez
    Laurent Larger
    Maxime Jacquot
    Yanne K. Chembo
    Daniel Brunner
    Scientific Reports, 8
  • [47] A recurrent neural network for real-time computation of semidefinite programming
    Jiang, DC
    Wang, J
    IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE, 1998, : 1640 - 1645
  • [48] Spike-based computation using classical recurrent neural networks
    De Geeter, Florent
    Ernst, Damien
    Drion, Guillaume
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2024, 4 (02):
  • [49] Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits
    Calderon, Cristian Buc
    Verguts, Tom
    Frank, Michael J.
    PLOS COMPUTATIONAL BIOLOGY, 2022, 18 (02)
  • [50] Real-time computation at the edge of chaos in recurrent neural networks
    Bertschinger, N
    Natschläger, T
    NEURAL COMPUTATION, 2004, 16 (07) : 1413 - 1436