GENERALIZATION IN A 2-LAYER NEURAL-NETWORK

被引：27

作者：

KANG, KJ ^{[1
]}

OH, JH ^{[1
]}

KWON, C ^{[1
]}

PARK, Y ^{[1
]}

机构：

[1] MYONG JI UNIV,DEPT PHYS,YONGIN,SOUTH KOREA

来源：

PHYSICAL REVIEW E | 1993年 / 48卷 / 06期

关键词：

D O I：

10.1103/PhysRevE.48.4805

中图分类号：

O35 [流体力学]; O53 [等离子体物理学];

学科分类号：

070204 ; 080103 ; 080704 ;

摘要：

Generalization in a fully connected two-layer neural network with N input nodes, M hidden nodes, a single output node, and binary weights is studied in the annealed approximation. When the number of examples is the order of N, the generalization error approaches a plateau and the system is in a permutation symmetric phase. When the number of examples is of the order of MN, the system undergoes a first-order phase transition to perfect generalisation and the permutation symmetry breaks. Results of the computer simulation show good agreement with analytic calculation

引用

页码：4805 / 4809

页数：5

共 50 条

[1] GENERALIZATION IN A 2-LAYER NEURAL NETWORK
SCHWARZE, H
OPPER, M
KINZEL, W
PHYSICAL REVIEW A, 1992, 46 (10): : R6185 - R6188
[2] LEARNING AND GENERALIZATION IN A 2-LAYER NEURAL-NETWORK - THE ROLE OF THE VAPNIK-CHERVONENKIS DIMENSION
OPPER, M
PHYSICAL REVIEW LETTERS, 1994, 72 (13) : 2113 - 2116
[3] GENERALIZATION IN 2-LAYER NEURAL NETWORKS
KANG, K
OH, JH
KWON, C
PARK, Y
JOURNAL OF THE KOREAN PHYSICAL SOCIETY, 1993, 26 : S396 - S398
[4] BIPOLAR PATTERN ASSOCIATION USING A 2-LAYER FEEDFORWARD NEURAL-NETWORK
HAO, JB
TAN, SH
VANDEWALLE, J
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1993, 40 (12): : 943 - 946
[5] GENERALIZATION IN A DILUTED NEURAL-NETWORK
DASILVA, CR
TAMARIT, FA
LEMKE, N
ARENZON, JJ
CURADO, EMF
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1995, 28 (06): : 1593 - 1602
[6] ON THE GENERALIZATION ABILITY OF NEURAL-NETWORK CLASSIFIERS
MUSAVI, MT
CHAN, KH
HUMMELS, DM
KALANTRI, K
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (06) : 659 - 663
[7] LEARNING IN A 2-LAYER NEURAL NETWORK OF EDGE DETECTORS
SOMPOLINSKY, H
TISHBY, N
EUROPHYSICS LETTERS, 1990, 13 (06): : 567 - 572
[8] Growing neural network for acquisition of 2-layer structure
Kurino, R
Sugisaka, M
Shibata, K
PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 2512 - 2517
[9] The ensemble approach to neural-network learning and generalization
Igelnik, B
Pao, YH
LeClair, SR
Shen, CY
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (01): : 19 - 30
[10] A 2-LAYER RADON-TRANSFORM CELLULAR NEURAL NETWORK
WU, CW
CHUA, LO
ROSKA, T
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 1992, 39 (07): : 488 - 489

← 1 2 3 4 5 →