Analysis and Design of Multivalued High-Capacity Associative Memories Based on Delayed Recurrent Neural Networks

被引:12
|
作者
Zhang, Jiahui [1 ]
Zhu, Song [1 ]
Bao, Gang [2 ]
Liu, Xiaoyang [3 ]
Wen, Shiping [4 ]
机构
[1] China Univ Min & Technol, Sch Math, Xuzhou 221116, Jiangsu, Peoples R China
[2] China Three Gorges Univ, Sch Hubei Key Lab Cascaded Hydropower Stat Operat, Yichang 443002, Peoples R China
[3] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[4] Univ Technol Sydney, Ctr Artificial Intelligence, Ultimo, NSW 2007, Australia
基金
中国国家自然科学基金;
关键词
Associative memory; Biological neural networks; Delays; Probes; Neurons; Delay effects; Stability analysis; exponential stability; mixed delays; multivalued activation functions; neural networks; ACTIVATION FUNCTIONS; EXTERNAL INPUTS; MULTISTABILITY; STABILITY;
D O I
10.1109/TCYB.2021.3095499
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article aims at analyzing and designing the multivalued high-capacity-associative memories based on recurrent neural networks with both asynchronous and distributed delays. In order to increase storage capacities, multivalued activation functions are introduced into associative memories. The stored patterns are retrieved by external input vectors instead of initial conditions, which can guarantee accurate associative memories by avoiding spurious equilibrium points. Some sufficient conditions are proposed to ensure the existence, uniqueness, and global exponential stability of the equilibrium point of neural networks with mixed delays. For neural networks with n neurons, m-dimensional input vectors, and 2k-valued activation functions, the autoassociative memories have (2k)(n) storage capacities and heteroassociative memories have min (2k)(n),(2k)(m) storage capacities. That is, the storage capacities of designed associative memories in this article are obviously higher than the 2(n) and min 2(n),2(m) storage capacities of the conventional ones. Three examples are given to support the theoretical results.
引用
收藏
页码:12989 / 13000
页数:12
相关论文
共 50 条
  • [41] FAULT-TOLERANCE OF ASSOCIATIVE MEMORIES BASED ON NEURAL NETWORKS
    RUCKERT, U
    KREUZER, I
    TRYBA, V
    GOSER, K
    [J]. VLSI AND COMPUTER PERIPHERALS: VLSI AND MICROELECTRONIC APPLICATIONS IN INTELLIGENT PERIPHERALS AND THEIR INTERCONNECTION NETWORKS, 1989, : A52 - A55
  • [42] On the Design of Hopfield Neural Networks: Synthesis of Hopfield Type Associative Memories
    Murthy, Garimella Rama
    Gabbouj, Moncef
    [J]. 2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [43] DESIGN OF MULTI-VALUED CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE MEMORIES
    Akiduki, Takuma
    Zhang, Zhong
    Imamura, Takashi
    Miyake, Tetsuo
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2012, 8 (3A): : 1575 - 1589
  • [44] Analysis of associative memories based on cellular neural networks with value-varying templates
    Han, Qi
    Cao, Rui
    Liu, Jin
    Huang, Junjian
    Yi, Jun
    Liu, Chao
    Weng, Tengfei
    [J]. INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2019, 96 (10) : 2024 - 2038
  • [45] Analysis and Synthesis of Associative Memories Based on Brain-State-in-a-Box Neural Networks
    Zeng, Zhigang
    Wang, Jun
    [J]. IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 1434 - +
  • [46] CONSTRUCTING ASSOCIATIVE MEMORIES USING HIGH-ORDER NEURAL NETWORKS
    TSENG, YH
    WU, JL
    [J]. ELECTRONICS LETTERS, 1992, 28 (12) : 1122 - 1124
  • [47] Bifurcation Analysis of Delayed Bidirectional Associative Memory Neural Networks
    Xiao, Min
    Meng, Wei Xing
    [J]. 2013 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2013, : 2319 - 2322
  • [48] ECG processing techniques based on neural networks and bidirectional associative memories
    Maglaveras, N.
    Stamkopoulos, T.
    Pappas, C.
    Strintzis, M.
    [J]. Journal of Medical Engineering and Technology, 1998, 22 (03): : 106 - 111
  • [49] A neural network with a single recurrent unit for associative memories based on linear optimization
    Liu, Qingshan
    Huang, Tingwen
    [J]. NEUROCOMPUTING, 2013, 118 : 263 - 267
  • [50] ECG processing techniques based on neural networks and bidirectional associative memories
    Maglaveras, N
    Stamkopoulos, T
    Pappas, C
    Strintzis, M
    [J]. JOURNAL OF MEDICAL ENGINEERING & TECHNOLOGY, 1998, 22 (03) : 106 - 111