Limit Set Dichotomy and Convergence of Cooperative Piecewise Linear Neural Networks

被引:29
|
作者
Di Marco, Mauro [1 ]
Forti, Mauro [1 ]
Grazzini, Massimo [1 ]
Pancioni, Luca [1 ]
机构
[1] Univ Siena, Dipartimento Ingn Informaz, I-53100 Siena, Italy
关键词
Convergence; cooperative neural networks; dynamical systems; limit set dichotomy; monotone and eventually strongly monotone semiflows; ORDER-PRESERVING SEMIFLOWS; DIFFERENTIAL-EQUATIONS; COMPLETE STABILITY; SYSTEMS; DYNAMICS; DELAY;
D O I
10.1109/TCSI.2010.2091194
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper considers a class of nonsymmetric cooperative neural networks (NNs) where the neurons are fully interconnected and the neuron activations are modeled by piecewise linear (PL) functions. The solution semiflow generated by cooperative PLNNs is monotone but, due to the horizontal segments in the neuron activations, is not eventually strongly monotone (ESM). The main result in this paper is that it is possible to prove a peculiar form of the LIMIT SET DICHOTOMY for this class of cooperative PLNNs. Such a form is slightly weaker than the standard form valid for ESM semiflows, but this notwithstanding it permits to establish a result on convergence analogous to that valid for ESM semiflows. Namely, for almost every choice of the initial conditions, each solution of a fully interconnected cooperative PLNN converges toward an equilibrium point, depending on the initial conditions, as t -> +infinity From a methodological viewpoint, this paper extends some basic techniques and tools valid for ESM semiflows, in order that they can be applied to the monotone semiflows generated by the considered class of cooperative PLNNs.
引用
收藏
页码:1052 / 1062
页数:11
相关论文
共 50 条
  • [31] Relationship Between the Number of Linear Regions and Expressive Power of Piecewise Linear Neural Networks
    Ma H.-T.
    Lu J.-R.
    Yu W.-X.
    Yu C.-Y.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2021, 42 (02): : 201 - 207
  • [32] Piecewise-linear artificial neural networks for PID controller tuning
    Dolezel, Petr
    Taufer, Ivan
    ACTA MONTANISTICA SLOVACA, 2012, 17 (03) : 224 - 233
  • [33] Complete Stability of Neural Networks With Nonmonotonic Piecewise Linear Activation Functions
    Nie, Xiaobing
    Zheng, Wei Xing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2015, 62 (10) : 1002 - 1006
  • [34] Piecewise Linear Units for Fast Self-Normalizing Neural Networks
    Chang, Yuanyuan
    Wu, Xiaofu
    Zhang, Suofei
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 429 - 434
  • [35] PIECEWISE-LINEAR DIVISION OF REGION BY NEURAL NETWORKS WITH MAXIMUM DETECTORS
    ZHUANG, J
    AMARI, S
    SYSTEMS AND COMPUTERS IN JAPAN, 1994, 25 (06) : 73 - 79
  • [36] A Simplicial Piecewise Linear Approach for Efficient Hardware Realization of Neural Networks
    Rodriguez, Nicolas
    Julian, Pedro
    Paolini, Eduardo
    2019 53RD ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2019,
  • [37] Design of approximate identity neural networks by piecewise-linear circuits
    TU of Brno, Brno, Czech Republic
    Inf, 1 (129-133):
  • [38] Robustness of convergence in finite time for linear programming neural networks
    Di Marco, M
    Forti, M
    Grazzini, M
    INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 2006, 34 (03) : 307 - 316
  • [39] Convergence Analysis for Learning Orthonormal Deep Linear Neural Networks
    Qin, Zhen
    Tan, Xuwei
    Zhu, Zhihui
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 795 - 799
  • [40] Asymptotic Convergence Rate of Dropout on Shallow Linear Neural Networks
    Senen-Cerda, Albert
    Sanders, Jaron
    PROCEEDINGS OF THE ACM ON MEASUREMENT AND ANALYSIS OF COMPUTING SYSTEMS, 2022, 6 (02)