Limit Set Dichotomy and Convergence of Cooperative Piecewise Linear Neural Networks

被引:29
|
作者
Di Marco, Mauro [1 ]
Forti, Mauro [1 ]
Grazzini, Massimo [1 ]
Pancioni, Luca [1 ]
机构
[1] Univ Siena, Dipartimento Ingn Informaz, I-53100 Siena, Italy
关键词
Convergence; cooperative neural networks; dynamical systems; limit set dichotomy; monotone and eventually strongly monotone semiflows; ORDER-PRESERVING SEMIFLOWS; DIFFERENTIAL-EQUATIONS; COMPLETE STABILITY; SYSTEMS; DYNAMICS; DELAY;
D O I
10.1109/TCSI.2010.2091194
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper considers a class of nonsymmetric cooperative neural networks (NNs) where the neurons are fully interconnected and the neuron activations are modeled by piecewise linear (PL) functions. The solution semiflow generated by cooperative PLNNs is monotone but, due to the horizontal segments in the neuron activations, is not eventually strongly monotone (ESM). The main result in this paper is that it is possible to prove a peculiar form of the LIMIT SET DICHOTOMY for this class of cooperative PLNNs. Such a form is slightly weaker than the standard form valid for ESM semiflows, but this notwithstanding it permits to establish a result on convergence analogous to that valid for ESM semiflows. Namely, for almost every choice of the initial conditions, each solution of a fully interconnected cooperative PLNN converges toward an equilibrium point, depending on the initial conditions, as t -> +infinity From a methodological viewpoint, this paper extends some basic techniques and tools valid for ESM semiflows, in order that they can be applied to the monotone semiflows generated by the considered class of cooperative PLNNs.
引用
收藏
页码:1052 / 1062
页数:11
相关论文
共 50 条
  • [1] Limit Set Dichotomy and Multistability for a Class of Cooperative Neural Networks With Delays
    Di Marco, Mauro
    Forti, Mauro
    Grazzini, Massimo
    Pancioni, Luca
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (09) : 1473 - 1485
  • [2] LIMIT SET DICHOTOMY AND CONVERGENCE OF SEMIFLOWS DEFINED BY COOPERATIVE STANDARD CNNs
    Di Marco, Mauro
    Forti, Mauro
    Grazzini, Massimo
    Pancioni, Luca
    INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2010, 20 (11): : 3549 - 3563
  • [3] Realization of limit cycles by neural networks with piecewise linear activation function
    Takahashi, N
    Yamakawa, T
    Nishi, T
    PROCEEDINGS OF THE 2005 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOL 3, 2005, : 7 - 10
  • [4] ON COMPLETENESS OF THE PIECEWISE LINEAR BASIS SET AND CONVERGENCE BEHAVIOR OF THE PIECEWISE LINEAR SERIES
    NOHARA, K
    MINAMOTO, S
    IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1981, 29 (05): : 1094 - 1096
  • [5] A cooperative system which does not satisfy the limit set dichotomy
    Sontag, Eduardo D.
    Wang, Yuan
    JOURNAL OF DIFFERENTIAL EQUATIONS, 2006, 224 (02) : 373 - 384
  • [6] On the Convergence of Piecewise Linear Strategic Interaction Dynamics on Networks
    Gharesifard, Bahman
    Touri, Behrouz
    Basar, Tamer
    Shamma, Jeff
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (06) : 1682 - 1687
  • [7] Networks of piecewise linear neural mass models
    Coombes, S.
    Lai, Y. M.
    Sayli, M.
    Thul, R.
    EUROPEAN JOURNAL OF APPLIED MATHEMATICS, 2018, 29 (05) : 869 - 890
  • [8] Piecewise linear neural networks and deep learning
    Nature Reviews Methods Primers, 2 (1):
  • [9] Piecewise linear neural networks and deep learning
    Tao, Qinghua
    Li, Li
    Huang, Xiaolin
    Xi, Xiangming
    Wang, Shuning
    Suykens, Johan A. K.
    NATURE REVIEWS METHODS PRIMERS, 2022, 2 (01):
  • [10] Piecewise linear neural networks and deep learning
    Qinghua Tao
    Li Li
    Xiaolin Huang
    Xiangming Xi
    Shuning Wang
    Johan A. K. Suykens
    Nature Reviews Methods Primers, 2