Inequalities of generalization errors for layered neural networks in Bayesian learning

被引：0

作者：

Watanabe, S ^{[1
]}

机构：

[1] Tokyo Inst Technol, Precis & Intelligence Lab, Midori Ku, Yokohama, Kanagawa 2268503, Japan

来源：

ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3 | 1998年

关键词：

Bayesian learning; layered neural networks; generalization error;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper proves inequalities of generalization errors for layered neural networks in Bayesian learning. It is shown that, if a three layer perceptron with M input units, H hidden units, and N output units is trained to learn the true model with H-1 hidden units, the generalization error is smaller than D/(2n) where D is the number of parameters and n is the number of training samples.

引用

页码：59 / 62

页数：4

共 50 条

[31] Generalization limits of Graph Neural Networks in identity effects learning
D'Inverno, Giuseppe Alessio
Brugiapaglia, Simone
Ravanelli, Mirco
NEURAL NETWORKS, 2025, 181
[32] Generalization Analysis of Pairwise Learning for Ranking With Deep Neural Networks
Huang, Shuo
Zhou, Junyu
Feng, Han
Zhou, Ding-Xuan
NEURAL COMPUTATION, 2023, 35 (06) : 1135 - 1158
[33] Exhaustive learning in neural networks: Generalization on statistically neutral problems
Ghorbani, AA
PROCEEDINGS OF THE FIFTH JOINT CONFERENCE ON INFORMATION SCIENCES, VOLS 1 AND 2, 2000, : 848 - 850
[34] Invariance, Encodings, and Generalization: Learning Identity Effects With Neural Networks
Brugiapaglia, S.
Liu, M.
Tupper, P.
NEURAL COMPUTATION, 2022, 34 (08) : 1756 - 1789
[35] Learning Cartographic Building Generalization with Deep Convolutional Neural Networks
Feng, Yu
Thiemann, Frank
Sester, Monika
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2019, 8 (06)
[36] Learning Errors by Radial Basis Function Neural Networks and Regularization Networks
Neruda, Roman
Vidnerova, Petra
INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2009, 2 (01): : 49 - 57
[37] Generalization and chaos in a layered neural network
Dominguez, DRC
Theumann, WK
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1997, 30 (05): : 1403 - 1414
[38] LEARNING, INVARIANCE, AND GENERALIZATION IN HIGH-ORDER NEURAL NETWORKS
GILES, CL
MAXWELL, T
APPLIED OPTICS, 1987, 26 (23): : 4972 - 4978
[39] Learning Bayesian belief networks with neural network estimators
Monti, S
Cooper, GF
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE, 1997, 9 : 578 - 584
[40] A hierarchical Bayesian learning scheme for autoregressive neural networks
Acernese, F
Barone, F
De Rosa, R
Eleuteri, A
Milano, L
Tagliaferri, R
PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 1356 - 1360

← 1 2 3 4 5 →