A self-organizing short-term dynamical memory network

被引:2
|
作者
Federer, Callie [1 ]
Zylberberg, Joel [1 ,2 ]
机构
[1] Univ Colorado, Dept Physiol & Biophys, Anschutz Med Campus, Boulder, CO 80309 USA
[2] Canadian Inst Adv Res, Learning Machines & Brains Program, Toronto, ON, Canada
基金
美国国家科学基金会;
关键词
Working memory; Dynamical systems; Recurrent neural networks; Synaptic plasticity; PARAMETRIC WORKING-MEMORY; PREFRONTAL CORTEX; PERSISTENT ACTIVITY; REPRESENTATIONS; MECHANISMS; SYNAPSES; CAPACITY; NEURONS;
D O I
10.1016/j.neunet.2018.06.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Working memory requires information about external stimuli to be represented in the brain even after those stimuli go away. This information is encoded in the activities of neurons, and neural activities change over timescales of tens of milliseconds. Information in working memory, however, is retained for tens of seconds, suggesting the question of how time-varying neural activities maintain stable representations. Prior work shows that, if the neural dynamics are in the 'null space' of the representation - so that changes to neural activity do not affect the downstream read-out of stimulus information - then information can be retained for periods much longer than the time-scale of individual-neuronal activities. The prior work, however, requires precisely constructed synaptic connectivity matrices, without explaining how this would arise in a biological neural network. To identify mechanisms through which biological networks can self-organize to learn memory function, we derived biologically plausible synaptic plasticity rules that dynamically modify the connectivity matrix to enable information storing. Networks implementing this plasticity rule can successfully learn to form memory representations even if only 10% of the synapses are plastic, they are robust to synaptic noise, and they can represent information about multiple stimuli. (C) 2018 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:30 / 41
页数:12
相关论文
共 50 条
  • [31] Towards a Self-organizing Network: An Algorithm
    Seljan, J.
    Simunic, D.
    Dimic, G.
    Vrandecic, B.
    2015 8TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2015, : 592 - 595
  • [32] A self-organizing wireless sensor network
    Mir, NF
    ESA'04 & VLSI'04, PROCEEDINGS, 2004, : 113 - 119
  • [33] A self-organizing concept formation network
    Homma, N
    Sakai, M
    Abe, K
    Takeda, H
    SICE 2003 ANNUAL CONFERENCE, VOLS 1-3, 2003, : 2337 - 2341
  • [34] Self-organizing network for variable clustering
    Liu, Gang
    Yang, Hui
    ANNALS OF OPERATIONS RESEARCH, 2018, 263 (1-2) : 119 - 140
  • [35] Self-organizing Shortcuts in an Overlay Network
    Lertsuwanakul, Lada-on
    Unger, Herwig
    AUTONOMOUS SYSTEMS: DEVELOPMENTS AND TRENDS, 2011, 391 : 119 - 131
  • [36] Self-Organizing Quantum Neural Network
    Zhou, RiGui
    Zheng, HongYuan
    Jiang, Nan
    Ding, QiuLin
    2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 1067 - +
  • [37] Self-organizing relationship (SOR) network
    Yamakawa, T
    Horio, K
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1999, E82A (08) : 1674 - 1677
  • [38] Self-organizing network for variable clustering
    Gang Liu
    Hui Yang
    Annals of Operations Research, 2018, 263 : 119 - 140
  • [39] A Secure Self-Organizing Sensor Network
    Marinescu, Dan C.
    Yu, Chen
    Marinescu, Gabriela M.
    SASOW 2008: SECOND IEEE INTERNATIONAL CONFERENCE ON SELF-ADAPTIVE AND SELF-ORGANIZING SYSTEMS WORKSHOPS, PROCEEDINGS, 2008, : 114 - 119
  • [40] Self-organizing relationship (SOR) network
    Kyushu Inst of Technology, Iizuka-shi, Japan
    IEICE Trans Fund Electron Commun Comput Sci, 8 (1674-1677):