ON THE GENERALIZATION ABILITY OF DILUTED PERCEPTRONS

被引:11
|
作者
KUHLMANN, P [1 ]
MULLER, KR [1 ]
机构
[1] TECH UNIV BERLIN 1,GMD FORSCHUNGSINST RECHNERARCHITEKUTUR & SOFTWARETECH,D-12489 BERLIN,GERMANY
来源
关键词
D O I
10.1088/0305-4470/27/11/026
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A linearly separable Boolean function is learned by a diluted perceptron with optimal stability. A different level of dilution is allowed for teacher and student perceptron. The learning algorithms used were the optimal annealed dilution and Hebbian dilution. The generalization ability, i.e. the probability to recognize a pattern which has not been learned before, is calculated in replica symmetry.
引用
收藏
页码:3759 / 3774
页数:16
相关论文
共 50 条
  • [41] A hybrid learning algorithm for multilayer perceptrons to improve generalization under sparse training data conditions
    Tonomura, M
    Nakayama, K
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 967 - 972
  • [42] On the generalization ability of on-line learning algorithms
    Cesa-Bianchi, N
    Conconi, A
    Gentile, C
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2004, 50 (09) : 2050 - 2057
  • [43] Generalization ability of a perceptron with nonmonotonic transfer function
    Inoue, J
    Nishimori, H
    Kabashima, Y
    PHYSICAL REVIEW E, 1998, 58 (01) : 849 - 860
  • [44] On the Generalization Ability of Retrieval-Enhanced Transformers
    Norlund, Tobias
    Doostmohammadi, Ehsan
    Johansson, Richard
    Kuhlmann, Marco
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1485 - 1493
  • [45] The Generalization Ability of Online Algorithms for Dependent Data
    Agarwal, Alekh
    Duchi, John C.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2013, 59 (01) : 573 - 587
  • [46] On the Generalization Ability of Geometric Semantic Genetic Programming
    Goncalves, Ivo
    Silva, Sara
    Fonseca, Carlos M.
    GENETIC PROGRAMMING (EUROGP 2015), 2015, 9025 : 41 - 52
  • [47] The generalization ability of logistic regression with Markov sampling
    Qian, Zhiyong
    Xiao, Wangsen
    Hu, Shulan
    ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (09): : 5250 - 5266
  • [48] GENERALIZATION ABILITY OF OPTIMAL CLUSTER SEPARATION NETWORKS
    WENDEMUTH, A
    JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1994, 27 (07): : 2325 - 2333
  • [49] IMPROVING A NETWORK GENERALIZATION ABILITY BY SELECTING EXAMPLES
    KINZEL, W
    RUJAN, P
    EUROPHYSICS LETTERS, 1990, 13 (05): : 473 - 477
  • [50] Analysis of the generalization ability of a full decision tree
    Genrikhov, I. E.
    COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 2014, 54 (06) : 1046 - 1059