A fast hybrid algorithm of global optimization for feedforward neural networks

被引：0

作者：

Jiang, MH ^{[1
]}

Zhu, XY ^{[1
]}

Yuan, BZ ^{[1
]}

Tang, XF ^{[1
]}

Lin, BQ ^{[1
]}

Ruan, QQ ^{[1
]}

Jiang, MY ^{[1
]}

机构：

[1] No Jiaotong Univ, Inst Sci Informat, Beijing 100044, Peoples R China

来源：

2000 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I-III | 2000年

关键词：

the conjugate gradient algorithm; global convergence; backpropagation; inexact line search;

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

This paper presents the hybrid algorithm of global optimization of dynamic learning rate for multilayer feedforward neural networks (MLFNN). The effect of inexact line search on conjugacy was studied and a generalized conjugate gradient method based on this effect was proposed and shown to have global convergence for error backpagation of MLFNN. The descent property and global convergence was given for the improved hybrid algrithm of conjugate gradient algorithm, the results of the proposed algorithm show a considerable improvement over the Fletcher-Rreeves algorithm and conventional BP algorithm, it overcomes the drawback of conventional BP and Polak-Ribieve conjugate gradient algorithm that maybe plung into local minima.

引用

页码：1609 / 1612

页数：4

共 50 条

[21] A hybrid linear/nonlinear training algorithm for feedforward neural networks
McLoone, S
Brown, MD
Irwin, G
Lightbody, G
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 669 - 684
[22] Hybrid optimization of feedforward neural networks for handwritten character recognition
Utschick, W
Nossek, JA
[J]. 1997 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I - V: VOL I: PLENARY, EXPERT SUMMARIES, SPECIAL, AUDIO, UNDERWATER ACOUSTICS, VLSI; VOL II: SPEECH PROCESSING; VOL III: SPEECH PROCESSING, DIGITAL SIGNAL PROCESSING; VOL IV: MULTIDIMENSIONAL SIGNAL PROCESSING, NEURAL NETWORKS - VOL V: STATISTICAL SIGNAL AND ARRAY PROCESSING, APPLICATIONS, 1997, : 147 - 150
[23] Optimization of feedforward neural networks
Han, J
Moraga, C
Sinne, S
[J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 1996, 9 (02) : 109 - 119
[24] Towards a Very Fast Feedforward Multilayer Neural Networks Training Algorithm
Bilski, Jaroslaw
Kowalczyk, Bartosz
Kisiel-Dorohinicki, Marek
Siwocha, Agnieszka
Zurada, Jacek
[J]. JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2022, 12 (03) : 181 - 195
[25] Fast terminal attractor based backpropagation algorithm for feedforward neural networks
Batbayar, Batsukh
Yu, Xinghuo
[J]. PROCEEDINGS OF THE 2007 INTERNATIONAL CONFERENCE ON INTELLIGENT SENSORS, SENSOR NETWORKS AND INFORMATION PROCESSING, 2007, : 521 - 525
[26] ODE-LM: A hybrid training algorithm for feedforward neural networks
[J]. Zhang, L. (lzhang@xidian.edu.cn), 1600, Springer Verlag (215):
[27] A new optimization algorithm for single hidden layer feedforward neural networks
Li, Leong Kwan
Shao, Sally
Yiu, Ka-Fai Cedric
[J]. APPLIED SOFT COMPUTING, 2013, 13 (05) : 2857 - 2862
[28] New algorithm of optimization layer by layer about feedforward neural networks
Zhang, Daiyuan
[J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2000, 13 (01): : 103 - 105
[29] Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network
Xia, HF
Dai, LK
[J]. 2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 202 - 205
[30] A HYBRID IWO/PSO ALGORITHM FOR FAST AND GLOBAL OPTIMIZATION
Hajimirsadeghi, Hossein
Lucas, Caro
[J]. EUROCON 2009: INTERNATIONAL IEEE CONFERENCE DEVOTED TO THE 150 ANNIVERSARY OF ALEXANDER S. POPOV, VOLS 1- 4, PROCEEDINGS, 2009, : 1964 - 1971

← 1 2 3 4 5 →