STORAGE CAPACITY AND GENERALIZATION ERROR FOR THE REVERSED-WEDGE ISING PERCEPTRON

被引:18
|
作者
BEX, GJ
SERNEELS, R
VANDENBROECK, C
机构
[1] Limburgs Universitair Centrum, Universitaire Campus
来源
PHYSICAL REVIEW E | 1995年 / 51卷 / 06期
关键词
D O I
10.1103/PhysRevE.51.6309
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
Using the replica formalism, we evaluate the storage capacity and the generalization error of a perceptron with a reversed-wedge transfer function and binary synaptic weights. Remarkably, both the storage capacity and the generalization threshold saturate the information theoretic (respectively upper and lower) bound α=1 for a specific choice of the width of the reverse wedge, suggesting that this perceptron may be an interesting building block for neural networks. © 1995 The American Physical Society.
引用
收藏
页码:6309 / 6312
页数:4
相关论文
共 31 条
  • [1] Weight space structure and generalization in the reversed-wedge perceptron
    Reimers, L
    Engel, A
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1996, 29 (14): : 3923 - 3937
  • [2] Learning the reversed-wedge problem using a multi-interacting perceptron with correlated weights
    Botelho, E
    [J]. PHYSICA A, 1998, 253 (1-4): : 323 - 332
  • [3] Domain sizes of the Gardner volume for the Ising reversed wedge perceptron
    Bex, GJ
    VandenBroeck, C
    [J]. PHYSICAL REVIEW E, 1997, 56 (01): : 870 - 876
  • [4] Generalization and learning error for nonlinear perceptron
    Shcherbina, M
    Tirozzi, B
    [J]. MATHEMATICAL AND COMPUTER MODELLING, 2002, 35 (3-4) : 259 - 271
  • [5] Capacity Lower Bound for the Ising Perceptron
    Ding, Jian
    Sun, Nike
    [J]. PROCEEDINGS OF THE 51ST ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING (STOC '19), 2019, : 816 - 827
  • [6] STORAGE CAPACITY OF A POTTS-PERCEPTRON
    NADAL, JP
    RAU, A
    [J]. JOURNAL DE PHYSIQUE I, 1991, 1 (08): : 1109 - 1121
  • [7] Localized generalization error model for Multilayer Perceptron Neural Networks
    Yang, Fei
    Ng, Wing W. Y.
    Tsang, Eric C. C.
    Zeng, Xiao-Qin
    Yeung, Daniel S.
    [J]. PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2008, : 794 - +
  • [8] CAPACITY AND ZERO-ERROR CAPACITY OF ISING CHANNELS
    BERGER, T
    BONOMI, F
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (01) : 173 - 180
  • [9] Training a perceptron by a bit sequence: Storage capacity
    Schroder, M
    Kinzel, W
    Kanter, I
    [J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1996, 29 (24): : 7965 - 7972
  • [10] Bounding Generalization Error Through Bias and Capacity
    Ramalingam, Ramya
    Dice, Nicolas Espinosa
    Kaye, Megan L.
    Montanez, George D.
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,