Limit Set Dichotomy and Convergence of Cooperative Piecewise Linear Neural Networks

被引:29
|
作者
Di Marco, Mauro [1 ]
Forti, Mauro [1 ]
Grazzini, Massimo [1 ]
Pancioni, Luca [1 ]
机构
[1] Univ Siena, Dipartimento Ingn Informaz, I-53100 Siena, Italy
关键词
Convergence; cooperative neural networks; dynamical systems; limit set dichotomy; monotone and eventually strongly monotone semiflows; ORDER-PRESERVING SEMIFLOWS; DIFFERENTIAL-EQUATIONS; COMPLETE STABILITY; SYSTEMS; DYNAMICS; DELAY;
D O I
10.1109/TCSI.2010.2091194
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper considers a class of nonsymmetric cooperative neural networks (NNs) where the neurons are fully interconnected and the neuron activations are modeled by piecewise linear (PL) functions. The solution semiflow generated by cooperative PLNNs is monotone but, due to the horizontal segments in the neuron activations, is not eventually strongly monotone (ESM). The main result in this paper is that it is possible to prove a peculiar form of the LIMIT SET DICHOTOMY for this class of cooperative PLNNs. Such a form is slightly weaker than the standard form valid for ESM semiflows, but this notwithstanding it permits to establish a result on convergence analogous to that valid for ESM semiflows. Namely, for almost every choice of the initial conditions, each solution of a fully interconnected cooperative PLNN converges toward an equilibrium point, depending on the initial conditions, as t -> +infinity From a methodological viewpoint, this paper extends some basic techniques and tools valid for ESM semiflows, in order that they can be applied to the monotone semiflows generated by the considered class of cooperative PLNNs.
引用
收藏
页码:1052 / 1062
页数:11
相关论文
共 50 条
  • [11] On the number of regions of piecewise linear neural networks
    Goujon, Alexis
    Etemadi, Arian
    Unser, Michael
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2024, 441
  • [12] Convergent design of piecewise linear neural networks
    Chandrasekaran, Hema
    Li, Jiang
    Delashmit, W. H.
    Narasimha, P. L.
    Yu, Changhua
    Manry, Michael T.
    NEUROCOMPUTING, 2007, 70 (4-6) : 1022 - 1039
  • [13] Multistability of Neural Networks with Piecewise Linear Activations
    Chen, Xiaofeng
    Zhou, Yafei
    Song, Qiankun
    PROCEEDINGS OF THE 7TH CONFERENCE ON BIOLOGICAL DYNAMIC SYSTEM AND STABILITY OF DIFFERENTIAL EQUATION, VOLS I AND II, 2010, : 558 - 561
  • [14] Analysis on the Number of Linear Regions of Piecewise Linear Neural Networks
    Hu, Qiang
    Zhang, Hao
    Gao, Feifei
    Xing, Chengwen
    An, Jianping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) : 644 - 653
  • [15] Activation Control of Multiple Piecewise Linear Neural Networks
    Hou, Chen
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 4895 - 4907
  • [16] Configuration of continuous piecewise-linear neural networks
    Wang, Shuning
    Huang, Xiaolin
    Junaid, Khan M.
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (08): : 1431 - 1445
  • [17] On the Number of Linear Regions of Convolutional Neural Networks With Piecewise Linear Activations
    Xiong, Huan
    Huang, Lei
    Zang, Wenston J. T.
    Zhen, Xiantong
    Xie, Guo-Sen
    Gu, Bin
    Song, Le
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (07) : 5131 - 5148
  • [18] Integrate and fire neural networks, piecewise contractive maps and limit cycles
    Eleonora Catsigeras
    Pierre Guiraud
    Journal of Mathematical Biology, 2013, 67 : 609 - 655
  • [19] On the ω-limit Set Dichotomy of Cooperating Kolmogorov Systems
    Jifa Jiang
    Yi Wang
    Positivity, 2003, 7 : 185 - 194
  • [20] Integrate and fire neural networks, piecewise contractive maps and limit cycles
    Catsigeras, Eleonora
    Guiraud, Pierre
    JOURNAL OF MATHEMATICAL BIOLOGY, 2013, 67 (03) : 609 - 655