Limit Set Dichotomy and Convergence of Cooperative Piecewise Linear Neural Networks

被引:29
|
作者
Di Marco, Mauro [1 ]
Forti, Mauro [1 ]
Grazzini, Massimo [1 ]
Pancioni, Luca [1 ]
机构
[1] Univ Siena, Dipartimento Ingn Informaz, I-53100 Siena, Italy
关键词
Convergence; cooperative neural networks; dynamical systems; limit set dichotomy; monotone and eventually strongly monotone semiflows; ORDER-PRESERVING SEMIFLOWS; DIFFERENTIAL-EQUATIONS; COMPLETE STABILITY; SYSTEMS; DYNAMICS; DELAY;
D O I
10.1109/TCSI.2010.2091194
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper considers a class of nonsymmetric cooperative neural networks (NNs) where the neurons are fully interconnected and the neuron activations are modeled by piecewise linear (PL) functions. The solution semiflow generated by cooperative PLNNs is monotone but, due to the horizontal segments in the neuron activations, is not eventually strongly monotone (ESM). The main result in this paper is that it is possible to prove a peculiar form of the LIMIT SET DICHOTOMY for this class of cooperative PLNNs. Such a form is slightly weaker than the standard form valid for ESM semiflows, but this notwithstanding it permits to establish a result on convergence analogous to that valid for ESM semiflows. Namely, for almost every choice of the initial conditions, each solution of a fully interconnected cooperative PLNN converges toward an equilibrium point, depending on the initial conditions, as t -> +infinity From a methodological viewpoint, this paper extends some basic techniques and tools valid for ESM semiflows, in order that they can be applied to the monotone semiflows generated by the considered class of cooperative PLNNs.
引用
收藏
页码:1052 / 1062
页数:11
相关论文
共 50 条
  • [41] Convergence analysis of neural networks that solve linear programming problems
    Ferreira, LV
    Kaszkurewicz, E
    Bhaya, A
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 2476 - 2481
  • [42] Reachable Set Estimation and Safety Verification for Piecewise Linear Systems with Neural Network Controllers
    Xiang, Weiming
    Hoang-Dung Tran
    Rosenfeld, Joel A.
    Johnson, Taylor T.
    2018 ANNUAL AMERICAN CONTROL CONFERENCE (ACC), 2018, : 1574 - 1579
  • [43] Infinite-width limit of deep linear neural networks
    Chizat, Lenaic
    Colombo, Maria
    Fernandez-Real, Xavier
    Figalli, Alessio
    COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2024, 77 (10) : 3958 - 4007
  • [44] Open and discrete maps with piecewise linear branch set images are piecewise linear maps
    Luisto, Rami
    Prywes, Eden
    JOURNAL OF THE LONDON MATHEMATICAL SOCIETY-SECOND SERIES, 2021, 103 (03): : 1186 - 1207
  • [45] Convergence results for some piecewise linear solvers
    Radons, Manuel
    Rump, Siegfried M.
    OPTIMIZATION LETTERS, 2022, 16 (06) : 1663 - 1673
  • [46] Convergence results for some piecewise linear solvers
    Manuel Radons
    Siegfried M. Rump
    Optimization Letters, 2022, 16 : 1663 - 1673
  • [47] A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions
    Jentzen, Arnulf
    Riekert, Adrian
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [48] Piecewise approximation and neural networks
    Revayova, Martina
    Torok, Csaba
    KYBERNETIKA, 2007, 43 (04) : 547 - 559
  • [49] Limit cycles created by piecewise linear centers
    Llibre, Jaume
    Zhang, Xiang
    CHAOS, 2019, 29 (05)
  • [50] The linear escape limit set
    Bishop, CJ
    PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY, 2004, 132 (05) : 1385 - 1388