Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

被引:11
|
作者
Liu, Yang [1 ]
Wang, Zhen [1 ]
Ma, Qian [2 ]
Shen, Hao [3 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Automation, Nanjing 210094, Peoples R China
[3] Anhui Univ Technol, Coll Elect & Informat Engn, Maanshan 243002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multistability; Recurrent neural networks; Time-varying delay; Piecewise nonlinear activation functions; Equilibrium points; ASSOCIATIVE MEMORY; GLOBAL STABILITY; DYNAMICAL BEHAVIORS; MULTIPERIODICITY; ATTRACTION; CRITERIA;
D O I
10.1016/j.neunet.2022.04.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the multistability of delayed recurrent neural networks (DRNNs) with a class of piecewise nonlinear activation functions. The coexistence as well as the stability of multiple equilibrium points (EPs) of DRNNs are proved. With the Brouwer's fixed point theorem as well as the Lagrange mean value theorem, it is obtained that under some conditions, the n-neuron DRNNs with the proposed activation function can have at least 5(n) EPs and 3(n) of them are locally stable. Compared with the DRNNs with sigmoidal activation functions, DRNNs with this kind of activation function can have more total EPs and more locally stable EPs. It implies that when designing DRNNs with the proposed activation function to apply in associative memory, it can have an even larger storage capacity. Furthermore, it is obtained that there exists a relationship between the number of the total EPs/stable EPs and the frequency of the sinusoidal function in the proposed activation function. Last, the above obtained results are extended to a more general case. It is shown that, DRNNs with the extended activation function can have (2k + 1)(n) EPs, (k + 1)(n) of which are locally stable, therein k is closely related to the frequency of the sinusoidal function in the extended activation function. Two simulation examples are given to verify the correctness of the theoretical results. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:80 / 89
页数:10
相关论文
共 50 条
  • [31] On Multistability of Competitive Neural Networks with Discontinuous Activation Functions
    Nie, Xiaobing
    Zheng, Wei Xing
    [J]. 2014 4TH AUSTRALIAN CONTROL CONFERENCE (AUCC), 2014, : 245 - 250
  • [32] Multistability of Switched Neural Networks With Piecewise Linear Activation Functions Under State-Dependent Switching
    Guo, Zhenyuan
    Liu, Linlin
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (07) : 2052 - 2066
  • [33] Multistability and attraction basins of discrete-time neural networks with nonmonotonic piecewise linear activation functions
    Wan, Peng
    Sun, Dihua
    Zhao, Min
    Wan, Li
    Jin, Shuang
    [J]. NEURAL NETWORKS, 2020, 122 : 231 - 238
  • [34] Complete stability of delayed recurrent neural networks with Gaussian activation functions
    Liu, Peng
    Zeng, Zhigang
    Wang, Jun
    [J]. NEURAL NETWORKS, 2017, 85 : 21 - 32
  • [35] Some multistability properties of bidirectional associative memory recurrent neural networks with unsaturating piecewise linear transfer functions
    Zhang, Lei
    Yi, Zhang
    Yu, Jiali
    Heng, Pheng Ann
    [J]. NEUROCOMPUTING, 2009, 72 (16-18) : 3809 - 3817
  • [36] Multistability in recurrent neural networks
    Cheng, Chang-Yuan
    Lin, Kuang-Hui
    Shih, Chih-Wen
    [J]. SIAM JOURNAL ON APPLIED MATHEMATICS, 2006, 66 (04) : 1301 - 1320
  • [37] Multistability of Recurrent Neural Networks With Nonmonotonic Activation Functions and Unbounded Time-Varying Delays
    Liu, Peng
    Zeng, Zhigang
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (07) : 3000 - 3010
  • [38] Multistability analysis of quaternion-valued neural networks with cosine activation functions *
    Yu, Siyi
    Li, Hua
    Chen, Xiaofeng
    Lin, Dongyuan
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2023, 445
  • [39] On exponential stability of delayed neural networks with a general class of activation functions
    Sun, CY
    Zhang, KJ
    Fei, SM
    Feng, CB
    [J]. PHYSICS LETTERS A, 2002, 298 (2-3) : 122 - 132
  • [40] Multistability and multiperiodicity of high-order competitive neural networks with a general class of activation functions
    Nie, Xiaobing
    Huang, Zhenkun
    [J]. NEUROCOMPUTING, 2012, 82 : 1 - 13