Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

被引:11
|
作者
Liu, Yang [1 ]
Wang, Zhen [1 ]
Ma, Qian [2 ]
Shen, Hao [3 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Automation, Nanjing 210094, Peoples R China
[3] Anhui Univ Technol, Coll Elect & Informat Engn, Maanshan 243002, Peoples R China
基金
中国国家自然科学基金;
关键词
Multistability; Recurrent neural networks; Time-varying delay; Piecewise nonlinear activation functions; Equilibrium points; ASSOCIATIVE MEMORY; GLOBAL STABILITY; DYNAMICAL BEHAVIORS; MULTIPERIODICITY; ATTRACTION; CRITERIA;
D O I
10.1016/j.neunet.2022.04.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the multistability of delayed recurrent neural networks (DRNNs) with a class of piecewise nonlinear activation functions. The coexistence as well as the stability of multiple equilibrium points (EPs) of DRNNs are proved. With the Brouwer's fixed point theorem as well as the Lagrange mean value theorem, it is obtained that under some conditions, the n-neuron DRNNs with the proposed activation function can have at least 5(n) EPs and 3(n) of them are locally stable. Compared with the DRNNs with sigmoidal activation functions, DRNNs with this kind of activation function can have more total EPs and more locally stable EPs. It implies that when designing DRNNs with the proposed activation function to apply in associative memory, it can have an even larger storage capacity. Furthermore, it is obtained that there exists a relationship between the number of the total EPs/stable EPs and the frequency of the sinusoidal function in the proposed activation function. Last, the above obtained results are extended to a more general case. It is shown that, DRNNs with the extended activation function can have (2k + 1)(n) EPs, (k + 1)(n) of which are locally stable, therein k is closely related to the frequency of the sinusoidal function in the extended activation function. Two simulation examples are given to verify the correctness of the theoretical results. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:80 / 89
页数:10
相关论文
共 50 条
  • [21] Multistability of Recurrent Neural Networks with Time-varying Delays and the Piecewise Linear Activation Function
    Zeng, Zhigang
    Huang, Tingwen
    Zheng, Wei Xing
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (08): : 1371 - 1377
  • [22] Multistability in a class of stochastic delayed Hopfield neural networks
    Chen, Wu-Hua
    Luo, Shixian
    Lu, Xiaomei
    [J]. NEURAL NETWORKS, 2015, 68 : 52 - 61
  • [23] Multistability of delayed complex-valued recurrent neural networks with discontinuous real-imaginary-type activation functions
    Huang Yu-Jiao
    Hu Hai-Gen
    [J]. CHINESE PHYSICS B, 2015, 24 (12)
  • [24] Multistability and instability of competitive neural networks with non-monotonic piecewise linear activation functions
    Nie, Xiaobing
    Cao, Jinde
    Fei, Shumin
    [J]. NONLINEAR ANALYSIS-REAL WORLD APPLICATIONS, 2019, 45 : 799 - 821
  • [25] Multistability and multiperiodicity of delayed bidirectional associative memory neural networks with discontinuous activation functions
    Huang, Yujiao
    Zhang, Huaguang
    Wang, Zhanshan
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2012, 219 (03) : 899 - 910
  • [26] Multistability and complete convergence analysis on high-order neural networks with a class of nonsmooth activation functions
    Wang, Lili
    Chen, Tianping
    [J]. NEUROCOMPUTING, 2015, 152 : 222 - 230
  • [27] Multistability of Fractional-Order Recurrent Neural Networks With Discontinuous and Nonmonotonic Activation Functions
    Huang, Yujiao
    Yuan, Xiaoyan
    Long, Haixia
    Fan, Xinggang
    Cai, Tiaoyang
    [J]. IEEE ACCESS, 2019, 7 : 116430 - 116437
  • [28] Multistability analysis for a general class of delayed Cohen-Grossberg neural networks
    Huang, Zhenkun
    Feng, Chunhua
    Mohamad, Sannay
    [J]. INFORMATION SCIENCES, 2012, 187 : 233 - 244
  • [29] Multistability of state-dependent switching neural networks with discontinuous nonmonotonic piecewise linear activation functions
    Zhang, Jiahui
    Zhu, Song
    Lu, Nannan
    Wen, Shiping
    [J]. NEUROCOMPUTING, 2021, 437 : 300 - 311
  • [30] Multiperiodicity and attractivity of delayed recurrent neural networks with unsaturating piecewise linear transfer functions
    Zhang, Lei
    Yi, Zhang
    Yu, Jiali
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (01): : 158 - 167