Robust local stability of multilayer recurrent neural networks

被引:40
|
作者
Suykens, JAK [1 ]
De Moor, B [1 ]
Vandewalle, J [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn, ESAT SISTA, B-3001 Heverlee, Belgium
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2000年 / 11卷 / 01期
关键词
dynamic backpropagation; linearization; matrix inequalities; NLq theory;
D O I
10.1109/72.822525
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we derive a condition for robust local stability of multilayer recurrent neural networks with two hidden layers, The stability condition follows from linking theory about linearization, robustness analysis of linear systems under nonlinear perturbation and matrix inequalities. A characterization of the basin of attraction of the origin is given in terms of the level set of a quadratic Lyapunov function. In a similar way like for NLq theory, local stability is imposed around the origin and the apparent basin of attraction is made large by applying the criterion, while the proven basin of attraction is relatively small due to conservatism of the criterion. Modifying dynamic backpropagation by the new stability condition is discussed and illustrated by simulation examples.
引用
收藏
页码:222 / 229
页数:8
相关论文
共 50 条
  • [41] Stability of Modular Recurrent Trainable Neural Networks
    Hernandez Manzano, Sergio Miguel
    Baruch, Ieroham
    NATURE-INSPIRED COMPUTATION AND MACHINE LEARNING, PT II, 2014, 8857 : 95 - 104
  • [42] STABILITY REGIONS OF RECURRENT TYPE NEURAL NETWORKS
    CILIZ, K
    HAROVA, A
    ELECTRONICS LETTERS, 1992, 28 (11) : 1022 - 1024
  • [43] Lyapunov stable learning laws for multilayer recurrent neural networks
    Salgado, Ivan
    Guarneros-Sandoval, Alejandro
    Ballesteros, Mariana
    Rodriguez-Santillan, Julia
    Chairez, Isaac
    NEUROCOMPUTING, 2022, 491 : 644 - 657
  • [44] Recurrent Neural Networks for Noise Reduction in Robust ASR
    Maas, Andrew L.
    Le, Quoc V.
    O'Neil, Tyler M.
    Vinyals, Oriol
    Nguyen, Patrick
    Ng, Andrew Y.
    13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 22 - 25
  • [45] RECURRENT DEEP NEURAL NETWORKS FOR ROBUST SPEECH RECOGNITION
    Weng, Chao
    Yu, Dong
    Watanabe, Shinji
    Juang, Biing-Hwang
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [46] Robust synchronization of coupled delayed recurrent neural networks
    Zhou, J
    Chen, TP
    Lan, X
    ADVANCES IN NEURAL NETWORKS - ISNN 2004, PT 1, 2004, 3173 : 144 - 149
  • [47] Robust Object Tracking Based on Recurrent Neural Networks
    Lotfi, F.
    Ajallooeian, V.
    Taghirad, H. D.
    2018 6TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM 2018), 2018, : 507 - 511
  • [48] Robust design of multilayer feedforward neural networks: an experimental approach
    Kim, YS
    Yum, BJ
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2004, 17 (03) : 249 - 263
  • [49] Robust recurrent neural networks for time series forecasting
    Zhang, Xueli
    Zhong, Cankun
    Zhang, Jianjun
    Wang, Ting
    Ng, Wing W. Y.
    NEUROCOMPUTING, 2023, 526 : 143 - 157
  • [50] Global Robust Stability for Neural Networks with Delays
    Li, Zhonghua
    Wang, Jianjun
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION WORKSHOP: IITA 2008 WORKSHOPS, PROCEEDINGS, 2008, : 189 - 192