Multistability of Hopfield neural networks with a designed discontinuous sawtooth-type activation function

被引:18
|
作者
Liu, Yang [1 ]
Huang, Xia [2 ]
Li, Yuxia [2 ]
Shen, Hao [3 ]
机构
[1] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao 266590, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[3] Anhui Univ Technol, Elect & Informat Engn, Maanshan 243002, Peoples R China
基金
中国国家自然科学基金;
关键词
Discontinuous activation functions; Equilibrium point; Hopfield neural networks; Multistability; DYNAMICAL BEHAVIORS; ASSOCIATIVE MEMORY; MULTIPERIODICITY; STABILITY;
D O I
10.1016/j.neucom.2021.05.045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a class of discontinuous sawtooth-type activation function is designed and the multistability of Hopfield neural networks (HNNs) with such kind of activation function is studied. By virtue of the Brouwer's fixed point theorem and the property of strictly diagonally dominant matrix (SDDM), some sufficient conditions are presented to ensure that the n-neuron HNN can have at least 7(n) equilibria, among which 4(n) equilibria are locally exponentially stable and the remaining 7(n)-4(n) equilibria are unstable. Then, the obtained results are extended to a more general case. We continue to increase the number of the peaks of the sawtooth-type activation function and we find that the n-neuron HNN can have (2k + 3)(n) equilibria, (k + 2)(n) of them are locally exponentially stable and the remaining equilibria are unstable. Therein, k denotes the total number of the peaks in the designed activation function. That is to say, there is a quantitative relationship between the number of the peaks and the number of the equilibria. It implies that one can improve the storage capacity of a HNN by increasing the number of the peaks of the activation function in theory and in practice. To some extent, this method is convenient and flexible. Compared with the existing results, HNN with the designed sawtooth-type activation function can have more total equilibria as well as more locally stable equilibria. Finally, two examples are presented to demonstrate the validity of the obtained results. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:189 / 201
页数:13
相关论文
共 50 条
  • [41] Hyperchaos in Hopfield-type neural networks
    Li, QD
    Yang, XS
    Yang, FY
    NEUROCOMPUTING, 2005, 67 : 275 - 280
  • [42] Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis
    Kaslik, Eva
    Sivasundaram, Seenith
    NEURAL NETWORKS, 2011, 24 (04) : 370 - 377
  • [43] Stability of Hopfield-type neural networks Ⅱ
    廖晓昕
    廖旸
    ScienceinChina,SerA., 1997, Ser.A.1997 (08) : 813 - 816
  • [44] Stability of Hopfield-type neural networks Ⅱ
    廖晓昕
    廖旸
    Science China Mathematics, 1997, (08) : 813 - 816
  • [45] Dynamics of Quaternionic Hopfield Type Neural Networks
    Garimella, Rama Murthy
    Anil, Rayala
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2017, PT I, 2017, 10305 : 351 - 361
  • [46] A novel type of activation function in artificial neural networks: Trained activation function
    Ertugrul, Omer Faruk
    NEURAL NETWORKS, 2018, 99 : 148 - 157
  • [47] On the Design of Hopfield Neural Networks: Synthesis of Hopfield Type Associative Memories
    Murthy, Garimella Rama
    Gabbouj, Moncef
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [48] Robust stability analysis of delayed Takagi-Sugeno fuzzy Hopfield neural networks with discontinuous activation functions
    Wu, Xiru
    Wang, Yaonan
    Huang, Lihong
    Zuo, Yi
    COGNITIVE NEURODYNAMICS, 2010, 4 (04) : 347 - 354
  • [49] Robust stability analysis of delayed Takagi-Sugeno fuzzy Hopfield neural networks with discontinuous activation functions
    Xiru Wu
    Yaonan Wang
    Lihong Huang
    Yi Zuo
    Cognitive Neurodynamics, 2010, 4 : 347 - 354
  • [50] Multistability of Recurrent Neural Networks with Time-varying Delays and the Piecewise Linear Activation Function
    Zeng, Zhigang
    Huang, Tingwen
    Zheng, Wei Xing
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (08): : 1371 - 1377