Self-organization and dynamics reduction in recurrent networks: stimulus presentation and learning

被引:36
|
作者
Dauce, E
Quoy, M
Cessac, B
Doyon, B
Samuelides, M
机构
[1] CERT DTIM, ONERA, F-31055 Toulouse 4, France
[2] UCP, ETIS, F-95014 Cergy Pontoise, France
[3] Inst Nonlineaire Nice, F-06560 Valbonne, France
[4] CHU Purpan, Serv Neurol, INSERM, U455, F-31059 Toulouse, France
[5] ENSAE, F-31055 Toulouse 4, France
关键词
asymmetric recurrent network; attractor neural networks; bifurcations; chaos; Hebbian learning rule; non-linear dynamics; self-organization; statistical neurodynamics;
D O I
10.1016/S0893-6080(97)00131-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Freeman's investigations on the olfactory bulb of the rabbit showed that its signal dynamics was chaotic, and that recognition of a learned stimulus is linked to a dimension reduction of the dynamics attractor. In this paper we address the question whether this behavior is specific of this particular architecture, or if it is a general property. We study the dynamics of a non-convergent recurrent model-the random recurrent neural networks. In that model a mean-field theory can be used to analyze the autonomous dynamics. We extend this approach with various observations on significant changes in the dynamical regime when sending static random stimuli. Then we propose a Hebb-like learning rule, viewed as a self-organization dynamical process inducing specific reactivity to one random stimulus. We numerically show the dynamics reduction during learning and recognition processes and analyze it in terms of dynamical repartition of local neural activity. (C) 1998 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:521 / 533
页数:13
相关论文
共 50 条
  • [1] Self-organization and dynamics reduction in recurrent networks: Stimulus presentation and learning
    ONERA-CERT/DTIM, 2 avenue Edouard Belin, BP 4025, 31055 Toulouse cedex 4, France
    不详
    不详
    不详
    不详
    [J]. Neural Netw, 3 (521-533):
  • [2] Incorporating structural plasticity into self-organization recurrent networks for sequence learning
    Yuan, Ye
    Zhu, Yongtong
    Wang, Jiaqi
    Li, Ruoshi
    Xu, Xin
    Fang, Tao
    Huo, Hong
    Wan, Lihong
    Li, Qingdu
    Liu, Na
    Yang, Shiyan
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [3] Self-organization of action hierarchy and compositionality by reinforcement learning with recurrent neural networks
    Han, Dongqi
    Doya, Kenji
    Tani, Jun
    [J]. NEURAL NETWORKS, 2020, 129 (129) : 149 - 162
  • [4] DYNAMICS OF SELF-ORGANIZATION IN COMPLEX ADAPTIVE NETWORKS
    DHUMIERES, D
    HUBERMAN, BA
    [J]. JOURNAL OF STATISTICAL PHYSICS, 1984, 34 (3-4) : 361 - 379
  • [5] Role of modularity in self-organization dynamics in biological networks
    Siebert, Bram A.
    Hall, Cameron L.
    Gleeson, James P.
    Asllani, Malbor
    [J]. PHYSICAL REVIEW E, 2020, 102 (05)
  • [6] Molecular System Dynamics for Self-Organization in Heterogeneous Wireless Networks
    Llorca, Jaime
    Milner, Stuart D.
    Davis, Christopher C.
    [J]. EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2010,
  • [7] Molecular System Dynamics for Self-Organization in Heterogeneous Wireless Networks
    Jaime Llorca
    Stuart D. Milner
    Christopher C. Davis
    [J]. EURASIP Journal on Wireless Communications and Networking, 2010
  • [8] Microscopic self-organization in networks
    Sun, K.
    Ouyang, Q.
    [J]. Physical Review E - Statistical, Nonlinear, and Soft Matter Physics, 2001, 64 (2 II): : 261111 - 261115
  • [9] Self-organization of collaboration networks
    Ramasco, JJ
    Dorogovtsev, SN
    Pastor-Satorras, R
    [J]. PHYSICAL REVIEW E, 2004, 70 (03)
  • [10] Self-organization in sensor networks
    Collier, TC
    Taylor, C
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2004, 64 (07) : 866 - 873