Analysis and Design of Multivalued High-Capacity Associative Memories Based on Delayed Recurrent Neural Networks

被引:12
|
作者
Zhang, Jiahui [1 ]
Zhu, Song [1 ]
Bao, Gang [2 ]
Liu, Xiaoyang [3 ]
Wen, Shiping [4 ]
机构
[1] China Univ Min & Technol, Sch Math, Xuzhou 221116, Jiangsu, Peoples R China
[2] China Three Gorges Univ, Sch Hubei Key Lab Cascaded Hydropower Stat Operat, Yichang 443002, Peoples R China
[3] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[4] Univ Technol Sydney, Ctr Artificial Intelligence, Ultimo, NSW 2007, Australia
基金
中国国家自然科学基金;
关键词
Associative memory; Biological neural networks; Delays; Probes; Neurons; Delay effects; Stability analysis; exponential stability; mixed delays; multivalued activation functions; neural networks; ACTIVATION FUNCTIONS; EXTERNAL INPUTS; MULTISTABILITY; STABILITY;
D O I
10.1109/TCYB.2021.3095499
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article aims at analyzing and designing the multivalued high-capacity-associative memories based on recurrent neural networks with both asynchronous and distributed delays. In order to increase storage capacities, multivalued activation functions are introduced into associative memories. The stored patterns are retrieved by external input vectors instead of initial conditions, which can guarantee accurate associative memories by avoiding spurious equilibrium points. Some sufficient conditions are proposed to ensure the existence, uniqueness, and global exponential stability of the equilibrium point of neural networks with mixed delays. For neural networks with n neurons, m-dimensional input vectors, and 2k-valued activation functions, the autoassociative memories have (2k)(n) storage capacities and heteroassociative memories have min (2k)(n),(2k)(m) storage capacities. That is, the storage capacities of designed associative memories in this article are obviously higher than the 2(n) and min 2(n),2(m) storage capacities of the conventional ones. Three examples are given to support the theoretical results.
引用
收藏
页码:12989 / 13000
页数:12
相关论文
共 50 条
  • [1] Design and Analysis of High-Capacity Associative Memories Based on a Class of Discrete-Time Recurrent Neural Networks
    Zeng, Zhigang
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (06): : 1525 - 1536
  • [2] Design and analysis of associative memories based on external inputs of delayed recurrent neural networks
    Zhang, Huaguang
    Huang, Yujiao
    Wang, Binrui
    Wang, Zhanshan
    [J]. NEUROCOMPUTING, 2014, 136 : 337 - 344
  • [3] MULTIVALUED ASSOCIATIVE MEMORIES BASED ON RECURRENT NETWORKS
    CHIUEH, TD
    TSAI, HK
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (02): : 364 - 366
  • [4] Design of High-Capacity Auto-Associative Memories Based on the Analysis of Complex-Valued Neural Networks
    Gong, Weiqiang
    Liang, Jinling
    Li, Dehao
    [J]. 2017 14TH INTERNATIONAL WORKSHOP ON COMPLEX SYSTEMS AND NETWORKS (IWCSN), 2017, : 161 - 168
  • [5] ON BINARY ASSOCIATIVE MEMORIES BASED ON RECURRENT NEURAL NETWORKS
    CHIUEH, TD
    [J]. JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 1994, 17 (01) : 55 - 62
  • [6] On binary associative memories based on recurrent neural networks
    Chiueh, Tzi-Dar
    [J]. Journal of the Chinese Institute of Engineers, Transactions of the Chinese Institute of Engineers,Series A/Chung-kuo Kung Ch'eng Hsuch K'an, 1994, 17 (01): : 55 - 62
  • [7] High capacity recurrent associative memories
    Davey, N
    Hunt, SP
    Adams, RG
    [J]. NEUROCOMPUTING, 2004, 62 : 459 - 491
  • [8] Synthesization of high-capacity auto-associative memories using complex-valued neural networks
    黄玉娇
    汪晓妍
    龙海霞
    杨旭华
    [J]. Chinese Physics B, 2016, 25 (12) : 198 - 205
  • [9] Synthesization of high-capacity auto-associative memories using complex-valued neural networks
    Huang, Yu-Jiao
    Wang, Xiao-Yan
    Long, Hai-Xia
    Yang, Xu-Hua
    [J]. CHINESE PHYSICS B, 2016, 25 (12)
  • [10] Analysis and design of associative memories based on stability of cellular neural networks
    Han, Qi
    Liao, Xiaofeng
    Huang, Tingwen
    Peng, Jun
    Li, Chuandong
    Huang, Hongyu
    [J]. NEUROCOMPUTING, 2012, 97 : 192 - 200