Short term memory in input-driven linear dynamical systems

被引:17
|
作者
Tino, Peter [1 ]
Rodan, Ali [2 ]
机构
[1] Univ Birmingham, Sch Comp Sci, Birmingham B15 2TT, W Midlands, England
[2] Univ Jordan, King Abdulla Sch Informat Technol 2, Amman, Jordan
基金
英国生物技术与生命科学研究理事会;
关键词
Short term memory capacity; Fisher memory curve; Recurrent neural network; Echo state network; Reservoir computing;
D O I
10.1016/j.neucom.2012.12.041
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate the relation between two quantitative measures characterizing short term memory in input driven dynamical systems, namely the short term memory capacity (MC) [3] and the Fisher memory curve (FMC) [2]. We show that even though MC and FMC map the memory structure of the system under investigation from two quite different perspectives, for linear input driven dynamical systems they are in fact closely related. In particular, under some assumptions, the two quantities can be interpreted as squared 'Mahalanobis' norms of images of the input vector under the system's dynamics. We also offer a detailed rigorous analysis of the relation between MC and FMC in cases of symmetric and cyclic dynamic couplings. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:58 / 63
页数:6
相关论文
共 50 条
  • [31] Input-Driven Double-Head Pushdown Automata
    Holzer, Markus
    Kutrib, Martin
    Malcher, Andreas
    Wendlandt, Matthias
    ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE, 2017, (252): : 128 - 142
  • [32] Input-Driven Dynamic Execution Prediction of Streaming Applications
    Aleen, Farhana
    Sharif, Monirul
    Pande, Santosh
    ACM SIGPLAN NOTICES, 2010, 45 (05) : 315 - 324
  • [33] State Complexity of Operations on Input-Driven Pushdown Automata
    Okhotin, Alexander
    Salomaa, Kai
    MATHEMATICAL FOUNDATIONS OF COMPUTER SCIENCE 2011, 2011, 6907 : 485 - 496
  • [34] State complexity of operations on input-driven pushdown automata
    Okhotin, Alexander
    Salomaa, Kai
    JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2017, 86 : 207 - 228
  • [35] THE ROLE OF DOPAMINE IN THE MAINTENANCE OF WORKING MEMORY IN PREFRONTAL CORTEX NEURONS: INPUT-DRIVEN VERSUS INTERNALLY-DRIVEN NETWORKS
    Versace, Massimiliano
    Zorzi, Marco
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2010, 20 (04) : 249 - 265
  • [36] Limited Nondeterminism of Input-Driven Pushdown Automata: Decidability and Complexity
    Han, Yo-Sub
    Ko, Sang-Ki
    Salomaa, Kai
    DESCRIPTIONAL COMPLEXITY OF FORMAL SYSTEMS, DCFS 2019, 2019, 11612 : 158 - 170
  • [37] Cortical pattern generation during dexterous movement is input-driven
    Britton A. Sauerbrei
    Jian-Zhong Guo
    Jeremy D. Cohen
    Matteo Mischiati
    Wendy Guo
    Mayank Kabra
    Nakul Verma
    Brett Mensh
    Kristin Branson
    Adam W. Hantman
    Nature, 2020, 577 : 386 - 391
  • [38] A Constrained Regularization Approach for Input-Driven Recurrent Neural Networks
    Reinhart R.F.
    Steil J.J.
    Differential Equations and Dynamical Systems, 2011, 19 (1-2) : 27 - 46
  • [39] Input-driven behavior: One extreme of the multisensory perceptual continuum
    Oie, KS
    Jeka, JJ
    BEHAVIORAL AND BRAIN SCIENCES, 2001, 24 (02) : 232 - +
  • [40] The echo index and multistability in input-driven recurrent neural networks
    Ceni, Andrea
    Ashwin, Peter
    Livi, Lorenzo
    Postlethwaite, Claire
    PHYSICA D-NONLINEAR PHENOMENA, 2020, 412