Stochastic dynamics and high capacity associative memories

被引:0
|
作者
Davey, N [1 ]
Adams, RG [1 ]
机构
[1] Univ Hertfordshire, Dept Comp Sci, Hatfield AL10 9AB, Herts, England
关键词
associative memory; attractor basins; Hopfield neural networks; learning rules; perceptron; performance measures; pseudo-inverse;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The addition of noise to the deterministic Hopfield network, trained with one shot Hebbian learning, is known to bring benefits in the elimination of spurious attractors. This paper extends the analysis to learning rules that have a much higher capacity. The relative energy of desired and spurious attractors is reported and the affect of adding noise to the dynamics is empirically investigated. It is found that the addition of noise brings even more benefit in the case of the higher capacity rules.
引用
收藏
页码:1666 / 1670
页数:5
相关论文
共 50 条
  • [1] High capacity recurrent associative memories
    Davey, N
    Hunt, SP
    Adams, RG
    NEUROCOMPUTING, 2004, 62 : 459 - 491
  • [2] High capacity associative memories and connection constraints
    Davey, N
    Adams, R
    CONNECTION SCIENCE, 2004, 16 (01) : 47 - 65
  • [3] High capacity associative memories and small world networks
    Davey, N
    Christianson, B
    Adams, R
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 177 - 182
  • [4] Evolving high capacity associative memories with efficient wiring
    Adams, R
    Calcraft, L
    Davey, N
    Proceedings of the International Joint Conference on Neural Networks (IJCNN), Vols 1-5, 2005, : 3168 - 3173
  • [5] Capacity analysis of high order correlation associative memories
    Jeng, Yih-Jyi
    Yeh, Chien-Chung
    Journal of the Chinese Institute of Electrical Engineering, Transactions of the Chinese Institute of Engineers, Series E/Chung KuoTien Chi Kung Chieng Hsueh K'an, 1995, 2 (03): : 205 - 221
  • [6] INFORMATION CAPACITY OF ASSOCIATIVE MEMORIES
    KUH, A
    DICKINSON, BW
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1989, 35 (01) : 59 - 68
  • [7] DYNAMICS OF HOPFIELD ASSOCIATIVE MEMORIES
    FORSHAW, MRB
    LECTURE NOTES IN COMPUTER SCIENCE, 1988, 301 : 90 - 99
  • [8] Storage capacity of kernel associative memories
    Caputo, B
    Niemann, H
    ARTIFICIAL NEURAL NETWORKS - ICANN 2002, 2002, 2415 : 51 - 56
  • [9] Exponential Capacity of Dense Associative Memories
    Lucibello, Carlo
    Mezard, Marc
    PHYSICAL REVIEW LETTERS, 2024, 132 (07)