Globally optimal parameters for on-line learning in multilayer neural networks

被引：31

作者：

Saad, D

Rattray, M

机构：

[1] Department of Computer Science and Applied Mathematics, Aston University, Birmingham

来源：

PHYSICAL REVIEW LETTERS | 1997年 / 79卷 / 13期

关键词：

D O I：

10.1103/PhysRevLett.79.2578

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

We present a framework for calculating globally optimal parameters, within a given time frame, for on-line learning in multilayer neural networks. We demonstrate the capability of this method by computing optimal learning rates in typical learning scenarios. A similar treatment allows one to determine the relevance of related training algorithms based on modifications to the basic gradient descent rule as well as to compare different training methods.

引用

页码：2578 / 2581

页数：4

共 50 条

[31] Neural networks:: an efficient approach to predict on-line the optimal coagulant dose
Deveughèle, S
Do-Quang, Z
[J]. 4TH WORLD WATER CONGRESS: INNOVATION IN DRINKING WATER TREATMENT, 2004, 4 (5-6): : 87 - 94
[32] On-line Gibbs learning. II. Application to perceptron and multilayer networks
Kim, JW
Sompolinsky, H
[J]. PHYSICAL REVIEW E, 1998, 58 (02) : 2348 - 2362
[33] Emergent on-line learning in min-max modular neural networks
Lu, BL
Ichikawa, M
[J]. IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 2650 - 2655
[34] Fault Prognosis of Mechanical Components Using On-Line Learning Neural Networks
Martinez-Rego, David
Fontenla-Romero, Oscar
Perez-Sanchez, Beatriz
Alonso-Betanzos, Amparo
[J]. ARTIFICIAL NEURAL NETWORKS-ICANN 2010, PT I, 2010, 6352 : 60 - 66
[35] Distributed On-line Learning for Random-Weight Fuzzy Neural Networks
Fierimonte, Roberto
Altilio, Rosa
Panella, Massimo
[J]. 2017 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2017,
[36] Efficient on-line learning method for radial basis function neural networks
Deng, C.
Xiong, F.L.
[J]. Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2001, 23 (05):
[37] An on-line learning algorithm for recurrent neural networks using variational methods
Oh, WG
Suh, BS
[J]. 40TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1 AND 2, 1998, : 659 - 662
[38] VOP: Architecture of a Processor for Vector Operations in On-line Learning of Neural Networks
Mahale, Gopinath
Nandy, Soumitra K.
Bhatia, Eshan
Narayan, Ranjani
[J]. 2016 29TH INTERNATIONAL CONFERENCE ON VLSI DESIGN AND 2016 15TH INTERNATIONAL CONFERENCE ON EMBEDDED SYSTEMS (VLSID), 2016, : 391 - 396
[39] Transient dynamics of on-line learning in two-layered neural networks
Biehl, M
Riegler, P
Wohler, C
[J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1996, 29 (16): : 4769 - 4780
[40] On-line learning Artificial Neural Networks for Stability Classification of Milling Processes
Friedrich, Jens
Hinze, Christoph
Lechler, Armin
Verl, Alexander
[J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2016, : 357 - 364

← 1 2 3 4 5 →