Multistability of Hopfield neural networks with a designed discontinuous sawtooth-type activation function

被引:18
|
作者
Liu, Yang [1 ]
Huang, Xia [2 ]
Li, Yuxia [2 ]
Shen, Hao [3 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[3] Anhui Univ Technol, Elect & Informat Engn, Maanshan 243002, Peoples R China
基金
中国国家自然科学基金;
关键词
Discontinuous activation functions; Equilibrium point; Hopfield neural networks; Multistability; DYNAMICAL BEHAVIORS; ASSOCIATIVE MEMORY; MULTIPERIODICITY; STABILITY;
D O I
10.1016/j.neucom.2021.05.045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a class of discontinuous sawtooth-type activation function is designed and the multistability of Hopfield neural networks (HNNs) with such kind of activation function is studied. By virtue of the Brouwer's fixed point theorem and the property of strictly diagonally dominant matrix (SDDM), some sufficient conditions are presented to ensure that the n-neuron HNN can have at least 7(n) equilibria, among which 4(n) equilibria are locally exponentially stable and the remaining 7(n)-4(n) equilibria are unstable. Then, the obtained results are extended to a more general case. We continue to increase the number of the peaks of the sawtooth-type activation function and we find that the n-neuron HNN can have (2k + 3)(n) equilibria, (k + 2)(n) of them are locally exponentially stable and the remaining equilibria are unstable. Therein, k denotes the total number of the peaks in the designed activation function. That is to say, there is a quantitative relationship between the number of the peaks and the number of the equilibria. It implies that one can improve the storage capacity of a HNN by increasing the number of the peaks of the activation function in theory and in practice. To some extent, this method is convenient and flexible. Compared with the existing results, HNN with the designed sawtooth-type activation function can have more total equilibria as well as more locally stable equilibria. Finally, two examples are presented to demonstrate the validity of the obtained results. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:189 / 201
页数:13
相关论文
共 50 条
  • [21] Multistability of Cohen-Grossberg neural networks based on activation functions with multiple discontinuous points
    Liu, Yang
    Wang, Zhen
    Huang, Xia
    CHAOS SOLITONS & FRACTALS, 2023, 173
  • [22] Self-modeling in Hopfield Neural Networks with Continuous Activation Function
    Zarco, Mario
    Froese, Tom
    8TH ANNUAL INTERNATIONAL CONFERENCE ON BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES, BICA 2017 (EIGHTH ANNUAL MEETING OF THE BICA SOCIETY), 2018, 123 : 573 - 578
  • [23] Quaternionic Hopfield neural networks with twin-multistate activation function
    Kobayashi, Masaki
    NEUROCOMPUTING, 2017, 267 : 304 - 310
  • [24] Multistability of Neural Networks with a Class of Activation Functions
    Wang, Lili
    Lu, Wenlian
    Chen, Tianping
    ADVANCES IN NEURAL NETWORKS - ISNN 2009, PT 1, PROCEEDINGS, 2009, 5551 : 323 - 332
  • [25] Multistability of Quaternion-Valued Recurrent Neural Networks with Discontinuous Nonmonotonic Piecewise Nonlinear Activation Functions
    Du, Weihao
    Xiang, Jianglian
    Tan, Manchun
    NEURAL PROCESSING LETTERS, 2023, 55 (05) : 5855 - 5884
  • [26] Multistability of state-dependent switching neural networks with discontinuous nonmonotonic piecewise linear activation functions
    Zhang, Jiahui
    Zhu, Song
    Lu, Nannan
    Wen, Shiping
    NEUROCOMPUTING, 2021, 437 (437) : 300 - 311
  • [27] Multistability and Multiperiodicity for a General Class of Delayed Cohen-Grossberg Neural Networks with Discontinuous Activation Functions
    Du, Yanke
    Li, Yanlu
    Xu, Rui
    DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2013, 2013
  • [28] Multistability of Quaternion-Valued Recurrent Neural Networks with Discontinuous Nonmonotonic Piecewise Nonlinear Activation Functions
    Weihao Du
    Jianglian Xiang
    Manchun Tan
    Neural Processing Letters, 2023, 55 : 5855 - 5884
  • [29] Multistability and Multiperiodicity for a Class of Cohen–Grossberg BAM Neural Networks with Discontinuous Activation Functions and Time Delays
    Yanke Du
    Rui Xu
    Neural Processing Letters, 2015, 42 : 417 - 435
  • [30] Dynamical behavior of delayed Hopfield neural networks with discontinuous activations
    Wang, Jiafu
    Huang, Lihong
    Guo, Zhenyuan
    APPLIED MATHEMATICAL MODELLING, 2009, 33 (04) : 1793 - 1802