Short term memory in input-driven linear dynamical systems

被引:17
|
作者
Tino, Peter [1 ]
Rodan, Ali [2 ]
机构
[1] Univ Birmingham, Sch Comp Sci, Birmingham B15 2TT, W Midlands, England
[2] Univ Jordan, King Abdulla Sch Informat Technol 2, Amman, Jordan
基金
英国生物技术与生命科学研究理事会;
关键词
Short term memory capacity; Fisher memory curve; Recurrent neural network; Echo state network; Reservoir computing;
D O I
10.1016/j.neucom.2012.12.041
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate the relation between two quantitative measures characterizing short term memory in input driven dynamical systems, namely the short term memory capacity (MC) [3] and the Fisher memory curve (FMC) [2]. We show that even though MC and FMC map the memory structure of the system under investigation from two quite different perspectives, for linear input driven dynamical systems they are in fact closely related. In particular, under some assumptions, the two quantities can be interpreted as squared 'Mahalanobis' norms of images of the input vector under the system's dynamics. We also offer a detailed rigorous analysis of the relation between MC and FMC in cases of symmetric and cyclic dynamic couplings. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:58 / 63
页数:6
相关论文
共 50 条
  • [1] Input-driven languages are linear conjunctive
    Okhotin, Alexander
    THEORETICAL COMPUTER SCIENCE, 2016, 618 : 52 - 71
  • [2] Discretization of nonlinear input-driven dynamical systems using the Adomian Decomposition Method
    Zhang, Yuanliang
    Chong, Kil To
    Kazantzis, Nikolaos
    Parlos, A. G.
    APPLIED MATHEMATICAL MODELLING, 2012, 36 (12) : 5856 - 5875
  • [3] A new approach to identification of input-driven dynamical systems from probability densities
    Nie, Xiaokai
    Birkin, Mark
    Luo, Jingjing
    INVERSE PROBLEMS, 2018, 34 (08)
  • [4] On invariant manifolds of nonlinear discrete-time input-driven dynamical systems
    Kazantzis, N
    PHYSICS LETTERS A, 2001, 292 (1-2) : 107 - 114
  • [5] Gelation in input-driven aggregation
    Krapivsky, P. L.
    Matveev, S. A.
    PHYSICAL REVIEW E, 2024, 110 (03)
  • [6] Input-driven control of rule-based expert systems
    Feruglio, Gabriel Valiente
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2015, 689 : 86 - 95
  • [7] Digging input-driven pushdown automata
    Kutrib, Martin
    Malcher, Andreas
    RAIRO-THEORETICAL INFORMATICS AND APPLICATIONS, 2021, 55 (55):
  • [8] Fault Localization Method by Utilizing Memory Map and Input-Driven Update Interval
    Kim, Kwanhyo
    Choi, Ki-Yong
    Lee, Jung-Won
    ADVANCED MULTIMEDIA AND UBIQUITOUS ENGINEERING: FUTURETECH & MUE, 2016, 393 : 181 - 188
  • [9] INPUT-DRIVEN LANGUAGES ARE IN LOG N DEPTH
    DYMOND, PW
    INFORMATION PROCESSING LETTERS, 1988, 26 (05) : 247 - 250
  • [10] Input-Driven Queue Automata with Internal Transductions
    Kutrib, Martin
    Malcher, Andreas
    Wendlandt, Matthias
    LANGUAGE AND AUTOMATA THEORY AND APPLICATIONS, LATA 2016, 2016, 9618 : 156 - 167