Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

被引:11
|
作者
Liu, Yang [1 ]
Wang, Zhen [1 ]
Ma, Qian [2 ]
Shen, Hao [3 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Automation, Nanjing 210094, Peoples R China
[3] Anhui Univ Technol, Coll Elect & Informat Engn, Maanshan 243002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multistability; Recurrent neural networks; Time-varying delay; Piecewise nonlinear activation functions; Equilibrium points; ASSOCIATIVE MEMORY; GLOBAL STABILITY; DYNAMICAL BEHAVIORS; MULTIPERIODICITY; ATTRACTION; CRITERIA;
D O I
10.1016/j.neunet.2022.04.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the multistability of delayed recurrent neural networks (DRNNs) with a class of piecewise nonlinear activation functions. The coexistence as well as the stability of multiple equilibrium points (EPs) of DRNNs are proved. With the Brouwer's fixed point theorem as well as the Lagrange mean value theorem, it is obtained that under some conditions, the n-neuron DRNNs with the proposed activation function can have at least 5(n) EPs and 3(n) of them are locally stable. Compared with the DRNNs with sigmoidal activation functions, DRNNs with this kind of activation function can have more total EPs and more locally stable EPs. It implies that when designing DRNNs with the proposed activation function to apply in associative memory, it can have an even larger storage capacity. Furthermore, it is obtained that there exists a relationship between the number of the total EPs/stable EPs and the frequency of the sinusoidal function in the proposed activation function. Last, the above obtained results are extended to a more general case. It is shown that, DRNNs with the extended activation function can have (2k + 1)(n) EPs, (k + 1)(n) of which are locally stable, therein k is closely related to the frequency of the sinusoidal function in the extended activation function. Two simulation examples are given to verify the correctness of the theoretical results. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:80 / 89
页数:10
相关论文
共 50 条
  • [1] Multistability analysis of delayed quaternion-valued neural networks with nonmonotonic piecewise nonlinear activation functions
    Tan, Manchun
    Liu, Yunfeng
    Xu, Desheng
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2019, 341 : 229 - 255
  • [2] Multistability of Delayed Recurrent Neural Networks with Mexican Hat Activation Functions
    Liu, Peng
    Zeng, Zhigang
    Wang, Jun
    [J]. NEURAL COMPUTATION, 2017, 29 (02) : 423 - 457
  • [3] Multistability of Quaternion-Valued Recurrent Neural Networks with Discontinuous Nonmonotonic Piecewise Nonlinear Activation Functions
    Du, Weihao
    Xiang, Jianglian
    Tan, Manchun
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (05) : 5855 - 5884
  • [4] Multistability of Quaternion-Valued Recurrent Neural Networks with Discontinuous Nonmonotonic Piecewise Nonlinear Activation Functions
    Weihao Du
    Jianglian Xiang
    Manchun Tan
    [J]. Neural Processing Letters, 2023, 55 : 5855 - 5884
  • [5] The multistability of delayed competitive neural networks with piecewise non-monotonic activation functions
    Zhang, Yan
    Qiao, Yuanhua
    Duan, Lijuan
    Miao, Jun
    [J]. MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2022, 45 (16) : 10295 - 10311
  • [6] Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions
    Nie, Xiaobing
    Cao, Jinde
    Fei, Shumin
    [J]. NEUROCOMPUTING, 2013, 119 : 281 - 291
  • [7] Multistability analysis for recurrent neural networks with unsaturating piecewise linear transfer functions
    Yi, Z
    Tan, KK
    Lee, TH
    [J]. NEURAL COMPUTATION, 2003, 15 (03) : 639 - 662
  • [8] Multistability of Neural Networks with a Class of Activation Functions
    Wang, Lili
    Lu, Wenlian
    Chen, Tianping
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2009, PT 1, PROCEEDINGS, 2009, 5551 : 323 - 332
  • [9] Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions
    Yi, Z
    Tan, KK
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (02): : 329 - 336
  • [10] Stability Analysis for a Class of Delayed Neural Networks with Nonlinear Homogeneous Activation Functions
    Wang, Man
    Chen, Boshan
    [J]. 2015 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2015, : 30 - 35