A fast hybrid algorithm of global optimization for feedforward neural networks

被引：0

作者：

Jiang, MH ^{[1
]}

Zhu, XY ^{[1
]}

Yuan, BZ ^{[1
]}

Tang, XF ^{[1
]}

Lin, BQ ^{[1
]}

Ruan, QQ ^{[1
]}

Jiang, MY ^{[1
]}

机构：

[1] No Jiaotong Univ, Inst Sci Informat, Beijing 100044, Peoples R China

来源：

2000 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I-III | 2000年

关键词：

the conjugate gradient algorithm; global convergence; backpropagation; inexact line search;

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

This paper presents the hybrid algorithm of global optimization of dynamic learning rate for multilayer feedforward neural networks (MLFNN). The effect of inexact line search on conjugacy was studied and a generalized conjugate gradient method based on this effect was proposed and shown to have global convergence for error backpagation of MLFNN. The descent property and global convergence was given for the improved hybrid algrithm of conjugate gradient algorithm, the results of the proposed algorithm show a considerable improvement over the Fletcher-Rreeves algorithm and conventional BP algorithm, it overcomes the drawback of conventional BP and Polak-Ribieve conjugate gradient algorithm that maybe plung into local minima.

引用

页码：1609 / 1612

页数：4

共 50 条

[1] A fast hybrid algorithm of global optimization for feedforward neural networks
Jiang, MH
Zhang, B
Zhu, XY
Jinag, MY
[J]. CHINESE JOURNAL OF ELECTRONICS, 2001, 10 (02) : 214 - 218
[2] A novel global hybrid algorithm for feedforward neural networks
Li, Hongru
Li, Hailong
Du, Yina
[J]. ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 3, PROCEEDINGS, 2007, 4493 : 9 - +
[3] A global optimization algorithm for training feedforward neural networks
Huanqin Li
[J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13 : 846 - 849
[4] A hybrid algorithm for weight and connectivity optimization in feedforward neural networks
Pettersson, F
Saxén, H
[J]. ARTIFICIAL NEURAL NETS AND GENETIC ALGORITHMS, PROCEEDINGS, 2003, : 47 - 52
[5] Global Optimization of Feedforward Neural Networks
LIANG Xun XIA Shaowei Department of Automation
[J]. Journal of Systems Science and Systems Engineering, 1993, (03) : 273 - 280
[6] A hybrid training algorithm for feedforward neural networks
Ben Nasr, Mounir
Chtourou, Mohamed
[J]. NEURAL PROCESSING LETTERS, 2006, 24 (02) : 107 - 117
[7] A Hybrid Training Algorithm for Feedforward Neural Networks
Mounir Ben Nasr
Mohamed Chtourou
[J]. Neural Processing Letters, 2006, 24 : 107 - 117
[8] New global optimization algorithm for training feedforward neural networks and its application
Li, Huan-Qin
Wan, Bai-Wu
[J]. Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2003, 23 (08):
[9] A FAST AND ROBUST LEARNING ALGORITHM FOR FEEDFORWARD NEURAL NETWORKS
WEYMAERE, N
MARTENS, JP
[J]. NEURAL NETWORKS, 1991, 4 (03) : 361 - 369
[10] A NOVEL FAST FEEDFORWARD NEURAL NETWORKS TRAINING ALGORITHM
Bilski, Jaroslaw
Kowalczyk, Bartosz
Marjanski, Andrzej
Gandor, Michal
Zurada, Jacek
[J]. JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2021, 11 (04) : 287 - 306

← 1 2 3 4 5 →