A self-organizing short-term dynamical memory network

被引:2
|
作者
Federer, Callie [1 ]
Zylberberg, Joel [1 ,2 ]
机构
[1] Univ Colorado, Dept Physiol & Biophys, Anschutz Med Campus, Boulder, CO 80309 USA
[2] Canadian Inst Adv Res, Learning Machines & Brains Program, Toronto, ON, Canada
基金
美国国家科学基金会;
关键词
Working memory; Dynamical systems; Recurrent neural networks; Synaptic plasticity; PARAMETRIC WORKING-MEMORY; PREFRONTAL CORTEX; PERSISTENT ACTIVITY; REPRESENTATIONS; MECHANISMS; SYNAPSES; CAPACITY; NEURONS;
D O I
10.1016/j.neunet.2018.06.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Working memory requires information about external stimuli to be represented in the brain even after those stimuli go away. This information is encoded in the activities of neurons, and neural activities change over timescales of tens of milliseconds. Information in working memory, however, is retained for tens of seconds, suggesting the question of how time-varying neural activities maintain stable representations. Prior work shows that, if the neural dynamics are in the 'null space' of the representation - so that changes to neural activity do not affect the downstream read-out of stimulus information - then information can be retained for periods much longer than the time-scale of individual-neuronal activities. The prior work, however, requires precisely constructed synaptic connectivity matrices, without explaining how this would arise in a biological neural network. To identify mechanisms through which biological networks can self-organize to learn memory function, we derived biologically plausible synaptic plasticity rules that dynamically modify the connectivity matrix to enable information storing. Networks implementing this plasticity rule can successfully learn to form memory representations even if only 10% of the synapses are plastic, they are robust to synaptic noise, and they can represent information about multiple stimuli. (C) 2018 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:30 / 41
页数:12
相关论文
共 50 条
  • [1] Time-series prediction using a regularized self-organizing long short-term memory neural network
    Duan, Hao-shan
    Meng, Xi
    Tang, Jian
    Qiao, Jun-fei
    APPLIED SOFT COMPUTING, 2023, 145
  • [2] A hierarchical self-organizing map model in short-term load forecasting
    Carpinteiro, OAS
    da Silva, APA
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2001, 31 (1-3) : 105 - 113
  • [3] A Hierarchical Self-Organizing Map Model in Short-Term Load Forecasting
    Otávio A. S. Carpinteiro
    Alexandre P. Alves da Silva
    Journal of Intelligent and Robotic Systems, 2001, 31 : 105 - 113
  • [4] Short-term load forecasting based on self-organizing fuzzy neural networks
    Mao, Huina
    Zeng, Xiao-Jun
    Leng, Gang
    Zhai, Yongjie
    Keane, John
    2007 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-4, 2007, : 1130 - +
  • [5] A Localized NARX Neural Network Model for Short-term Load Forecasting Based upon Self-Organizing Mapping
    Li, Hanshen
    Zhu, Yuan
    Hu, Jinglu
    Li, Zhe
    2017 IEEE 3RD INTERNATIONAL FUTURE ENERGY ELECTRONICS CONFERENCE AND ECCE ASIA (IFEEC 2017-ECCE ASIA), 2017, : 749 - 754
  • [6] An improved self-organizing incremental neural network model for short-term time-series load prediction
    Ng, Rong Wang
    Begam, Kasim Mumtaj
    Rajkumar, Rajprasad Kumar
    Wong, Yee Wan
    Chong, Lee Wai
    APPLIED ENERGY, 2021, 292
  • [7] Short-term load forecasting based on self-organizing map and support vector machine
    Bao, ZJ
    Pi, DY
    Sun, YX
    ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 688 - 691
  • [8] Autocorrelation Based Weighing Strategy for Short-Term Load Forecasting with the Self-Organizing Map
    Yadav, Vineet
    Srinivasan, Dipti
    2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 1, 2010, : 186 - 192
  • [9] Short-term fuzzy traffic flow prediction using self-organizing TSK-Type fuzzy neural network
    Zhao, Liang
    Wang, Fei-Yue
    2007 IEEE INTERNATIONAL CONFERENCE ON VEHICULAR ELECTRONICS AND SAFETY, PROCEEDINGS, 2007, : 294 - 299
  • [10] An Improved Self-Organizing Migration Algorithm for Short-Term Load Forecasting with LSTM Structure Optimization
    Rong, Xiaofeng
    Zhou, Hanghang
    Cao, Zijian
    Wang, Chang
    Fan, Linjuan
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022