A self-organizing short-term dynamical memory network

被引:2
|
作者
Federer, Callie [1 ]
Zylberberg, Joel [1 ,2 ]
机构
[1] Univ Colorado, Dept Physiol & Biophys, Anschutz Med Campus, Boulder, CO 80309 USA
[2] Canadian Inst Adv Res, Learning Machines & Brains Program, Toronto, ON, Canada
基金
美国国家科学基金会;
关键词
Working memory; Dynamical systems; Recurrent neural networks; Synaptic plasticity; PARAMETRIC WORKING-MEMORY; PREFRONTAL CORTEX; PERSISTENT ACTIVITY; REPRESENTATIONS; MECHANISMS; SYNAPSES; CAPACITY; NEURONS;
D O I
10.1016/j.neunet.2018.06.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Working memory requires information about external stimuli to be represented in the brain even after those stimuli go away. This information is encoded in the activities of neurons, and neural activities change over timescales of tens of milliseconds. Information in working memory, however, is retained for tens of seconds, suggesting the question of how time-varying neural activities maintain stable representations. Prior work shows that, if the neural dynamics are in the 'null space' of the representation - so that changes to neural activity do not affect the downstream read-out of stimulus information - then information can be retained for periods much longer than the time-scale of individual-neuronal activities. The prior work, however, requires precisely constructed synaptic connectivity matrices, without explaining how this would arise in a biological neural network. To identify mechanisms through which biological networks can self-organize to learn memory function, we derived biologically plausible synaptic plasticity rules that dynamically modify the connectivity matrix to enable information storing. Networks implementing this plasticity rule can successfully learn to form memory representations even if only 10% of the synapses are plastic, they are robust to synaptic noise, and they can represent information about multiple stimuli. (C) 2018 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:30 / 41
页数:12
相关论文
共 50 条
  • [21] Attractor memory with self-organizing input
    Johansson, C
    Lansner, A
    BIOLOGICALLY INSPIRED APPROACHES TO ADVANCED INFORMATION TECHNOLOGY, PROCEEDINGS, 2006, 3853 : 265 - 280
  • [22] MULTIMODAL SENSORY MOTOR COORDINATION BY LEARNING IN DYNAMICAL SELF-ORGANIZING RELATIONSHIP NETWORK
    Sakaguchi, Shunsuke
    Horio, Keiichi
    Yamakawa, Takeshi
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2011, 7 (10): : 6097 - 6114
  • [23] A Self-Organizing Model for Affective Memory
    Barros, Pablo
    Wermter, Stefan
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 31 - 38
  • [24] A Multidirectional Associative Memory Based on Self-organizing Incremental Neural Network
    Yu, Hui
    Shen, Furao
    Hasegawa, Osamu
    NEURAL INFORMATION PROCESSING: MODELS AND APPLICATIONS, PT II, 2010, 6444 : 344 - +
  • [25] A general associative memory based on self-organizing incremental neural network
    Shen, Furao
    Ouyang, Qiubao
    Kasai, Wataru
    Hasegawa, Osamu
    NEUROCOMPUTING, 2013, 104 : 57 - 71
  • [26] Short-Term Load Forecasting using A Long Short-Term Memory Network
    Liu, Chang
    Jin, Zhijian
    Gu, Jie
    Qiu, Caiming
    2017 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE EUROPE (ISGT-EUROPE), 2017,
  • [28] Short-term memory in olfactory network dynamics
    Stopfer, M
    Laurent, G
    NATURE, 1999, 402 (6762) : 664 - 668
  • [29] Short-term memory in olfactory network dynamics
    Mark Stopfer
    Gilles Laurent
    Nature, 1999, 402 : 664 - 668
  • [30] Self-organized Short-Term Memory Mechanism in Spiking Neural Network
    Kiselev, Mikhail
    ADAPTIVE AND NATURAL COMPUTING ALGORITHMS, PT I, 2011, 6593 : 120 - 129