Improving Leung's bidirectional learning rule for associative memories

被引:5
|
作者
Lenze, B [1 ]
机构
[1] Univ Appl Sci, Fachhsch Dortmund, Dept Comp Sci, D-44047 Dortmund, Germany
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2001年 / 12卷 / 05期
关键词
bidirectional associative memory (BAM); bidirectional learning; conditional strong linear separability; dilation; translation;
D O I
10.1109/72.950150
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In 1994, Leung introduced a Perceptron-like learning rule to enhance the recall performance of bidirectional associative memories (BAMs). He proved that his so-called bidirectional learning scheme always yields a solution within a finite number of learning iterations in case that a solution exists. Unfortunately, in the setting of Leung a solution only exists in case that the training set is strongly linear separable by hyperplanes through the origin (both with respect to input and output patterns). Here, our idea enters the field. We will extend Leung's approach by considering conditionally strong linear separable sets allowing separating hyperplanes not containing the origin. Moreover, we will deal with BAMs, which are generalized by defining so-called dilation and translation parameters enlarging their capacity, while leaving their complexity almost unaffected. The whole approach will lead to a generalized bidirectional learning rule which generates BAMs with dilation and translation that perform perfectly on the training set in case that the latter satisfies the conditionally strong linear separability assumption. Therefore, in the sense of Leung, we will end up with an optimal learning strategy which contains Leung's initial idea as a special case.
引用
收藏
页码:1222 / 1226
页数:5
相关论文
共 50 条
  • [1] Bidirectional Associative Memories for Adaptive Rule Based Systems
    Hewahi, Nabil M.
    [J]. BRAIN-BROAD RESEARCH IN ARTIFICIAL INTELLIGENCE AND NEUROSCIENCE, 2019, 10 (02): : 74 - 84
  • [2] Bidirectional Associative Memories: Unsupervised Hebbian Learning to Bidirectional Backpropagation
    Kosko, Bart
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (01): : 103 - 115
  • [3] BIDIRECTIONAL ASSOCIATIVE MEMORIES
    KOSKO, B
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1988, 18 (01): : 49 - 60
  • [4] OPTIMAL GRADIENT DESCENT LEARNING FOR BIDIRECTIONAL ASSOCIATIVE MEMORIES
    PERFETTI, R
    [J]. ELECTRONICS LETTERS, 1993, 29 (17) : 1556 - 1557
  • [5] WEIGHTED LEARNING OF BIDIRECTIONAL ASSOCIATIVE MEMORIES BY GLOBAL MINIMIZATION
    WANG, T
    ZHUANG, XH
    XING, XL
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (06): : 1010 - 1018
  • [6] High performance learning rule for bidirectional associative memory
    Leung, Chi Sing
    Chan, Lai Wan
    Sum, John Pui Fai
    [J]. Neural Network World, 1997, 7 (03): : 325 - 334
  • [7] Thermodynamics of bidirectional associative memories
    Barra, Adriano
    Catania, Giovanni
    Decelle, Aurelien
    Seoane, Beatriz
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2023, 56 (20)
  • [8] EXPONENTIAL BIDIRECTIONAL ASSOCIATIVE MEMORIES
    JENG, YJ
    YEH, CC
    CHIUEH, TD
    [J]. ELECTRONICS LETTERS, 1990, 26 (11) : 717 - 718
  • [9] Morphological bidirectional associative memories
    Ritter, GX
    Diaz-De-Leon, JL
    Sussner, P
    [J]. NEURAL NETWORKS, 1999, 12 (06) : 851 - 867
  • [10] ADAPTIVE BIDIRECTIONAL ASSOCIATIVE MEMORIES
    KOSKO, B
    [J]. APPLIED OPTICS, 1987, 26 (23): : 4947 - 4960