Autonomous development of decorrelation filters in neural networks with recurrent inhibition

被引:7
|
作者
Jonker, HJJ
Coolen, ACC
van der Gon, JJD
机构
[1] Univ Utrecht, Helmholtz Inst, NL-3584 CC Utrecht, Netherlands
[2] Univ London Kings Coll, Dept Math, London WC2R 2LS, England
关键词
D O I
10.1088/0954-898X/9/3/005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We perform a quantitative analysis of information processing in a simple neural network model with recurrent inhibition. We postulate that both excitatory and inhibitory synapses continually adapt according to the following Hebbian-type rules: for excitatory synapses correlated pre- and post-synaptic activity induces enhanced excitation; for inhibitory synapses it induces enhanced inhibition. Following synaptic equilibration in unsupervised learning processes, the model is found to perform a novel type of principal-component analysis which involves filtering and decorrelation. In the light of these results we discuss the possible role of the granule-/Golgi-cell subnetwork in the cerebellum.
引用
收藏
页码:345 / 362
页数:18
相关论文
共 50 条
  • [1] Decorrelation by Recurrent Inhibition in Heterogeneous Neural Circuits
    Bernacchia, Alberto
    Wang, Xiao-Jing
    [J]. NEURAL COMPUTATION, 2013, 25 (07) : 1732 - 1767
  • [2] Convolutional Neural Networks with Recurrent Neural Filters
    Yang, Yi
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 912 - 917
  • [3] Intrinsic Adaptation in Autonomous Recurrent Neural Networks
    Markovic, Dimitrije
    Gros, Claudius
    [J]. NEURAL COMPUTATION, 2012, 24 (02) : 523 - 540
  • [4] Nonlinear Bayesian Filters for Training Recurrent Neural Networks
    Arasaratnam, Ienkaran
    Haykin, Simon
    [J]. MICAI 2008: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2008, 5317 : 12 - 33
  • [5] Gaussian sum filters for recurrent neural networks training
    Todorovic, Branimir
    Stankovic, Miomir
    Moraga, Claudio
    [J]. NEUREL 2006: EIGHT SEMINAR ON NEURAL NETWORK APPLICATIONS IN ELECTRICAL ENGINEERING, PROCEEDINGS, 2006, : 53 - +
  • [6] Neural networks for blind decorrelation of signals
    Douglas, SC
    Cichocki, A
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (11) : 2829 - 2842
  • [7] Parallel nonlinear adaptive digital filters using recurrent neural networks
    Cao, JT
    Yahagi, T
    [J]. ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 1997, 80 (12): : 91 - 101
  • [8] Parallel nonlinear adaptive digital filters using recurrent neural networks
    Cao, JT
    Yahagi, T
    [J]. ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 1997, 80 (03): : 83 - 93
  • [9] Temporal decorrelation of collective oscillations in neural networks with local inhibition and long-range excitation
    Battaglia, Demian
    Brunel, Nicolas
    Hansel, David
    [J]. PHYSICAL REVIEW LETTERS, 2007, 99 (23)
  • [10] Recurrent neural networks in synthetic cells: a route to autonomous molecular agents?
    Braccini, Michele
    Collinson, Ethan
    Roli, Andrea
    Fellermann, Harold
    Stano, Pasquale
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2023, 11