A self-organizing short-term dynamical memory network

被引:2
|
作者
Federer, Callie [1 ]
Zylberberg, Joel [1 ,2 ]
机构
[1] Univ Colorado, Dept Physiol & Biophys, Anschutz Med Campus, Boulder, CO 80309 USA
[2] Canadian Inst Adv Res, Learning Machines & Brains Program, Toronto, ON, Canada
基金
美国国家科学基金会;
关键词
Working memory; Dynamical systems; Recurrent neural networks; Synaptic plasticity; PARAMETRIC WORKING-MEMORY; PREFRONTAL CORTEX; PERSISTENT ACTIVITY; REPRESENTATIONS; MECHANISMS; SYNAPSES; CAPACITY; NEURONS;
D O I
10.1016/j.neunet.2018.06.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Working memory requires information about external stimuli to be represented in the brain even after those stimuli go away. This information is encoded in the activities of neurons, and neural activities change over timescales of tens of milliseconds. Information in working memory, however, is retained for tens of seconds, suggesting the question of how time-varying neural activities maintain stable representations. Prior work shows that, if the neural dynamics are in the 'null space' of the representation - so that changes to neural activity do not affect the downstream read-out of stimulus information - then information can be retained for periods much longer than the time-scale of individual-neuronal activities. The prior work, however, requires precisely constructed synaptic connectivity matrices, without explaining how this would arise in a biological neural network. To identify mechanisms through which biological networks can self-organize to learn memory function, we derived biologically plausible synaptic plasticity rules that dynamically modify the connectivity matrix to enable information storing. Networks implementing this plasticity rule can successfully learn to form memory representations even if only 10% of the synapses are plastic, they are robust to synaptic noise, and they can represent information about multiple stimuli. (C) 2018 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:30 / 41
页数:12
相关论文
共 50 条
  • [41] Self-organizing Internet semantic network
    Shumsky, S
    ADVANCES IN SELF-ORGANISING MAPS, 2001, : 61 - 66
  • [42] A self-organizing network for the systems community
    Ríos, JN
    KYBERNETES, 2004, 33 (3-4) : 590 - 606
  • [43] Recursive self-organizing network models
    Hammer, B
    Micheli, A
    Sperduti, A
    Strickert, M
    NEURAL NETWORKS, 2004, 17 (8-9) : 1061 - 1085
  • [44] Short-Term Photovoltaic Power Forecast Based on Long Short-Term Memory Network
    Shi, Min
    Xu, Ke
    Wang, Jue
    Yin, Rui
    Wang, Tieqiang
    Yong, Taiyou
    Hongyuan, Tianjin
    PROCEEDINGS OF 2019 IEEE 3RD INTERNATIONAL ELECTRICAL AND ENERGY CONFERENCE (CIEEC), 2019, : 2110 - 2116
  • [45] Dynamical analysis of continous self-organizing cortical maps
    Meyer-Base, A
    APPLICATIONS AND SCIENCE OF COMPUTATIONAL INTELLIGENCE, 1998, 3390 : 586 - 592
  • [46] Building autonomy within self-organizing dynamical agents
    D'Angelo, A
    Montesello, F
    Pagello, E
    INTELLIGENT AUTONOMOUS SYSTEMS 6, 2000, : 43 - 50
  • [47] Self-organizing dynamical networks able to learn autonomously
    Kaluza, Pablo
    EPL, 2018, 123 (05)
  • [48] Self-organizing dynamical systems theory and analytic psychotherapy
    Rubenfeld, S
    DYNAMISCHE PSYCHIATRIE, 2003, 36 (1-2): : 60 - 72
  • [49] Self-organizing Connectivity for Mobile Agents in Dynamical Environments
    Aldunate, Roberto G.
    Pena-Mora, Feniosky
    Nussbaum, Miguel
    Valenzuela, Alfredo
    Navarro, Cesar
    UBIQUITOUS COMPUTING AND AMBIENT INTELLIGENCE, UCAMI 2016, PT II, 2016, 10070 : 230 - 241
  • [50] Short-term Load Forecasting of Distribution Network Based on Combination of Siamese Network and Long Short-term Memory Network
    Ge L.
    Zhao K.
    Sun Y.
    Wang Y.
    Niu F.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2021, 45 (23): : 41 - 50