TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM

被引：5416
|
作者：
HAGAN, MT
MENHAJ, MB
机构：
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1994年 / 5卷 / 06期
关键词：
D O I：
10.1109/72.329697
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The Marquardt algorithm for nonlinear least squares is presented and is incorporated into the backpropagation algorithm for training feedforward neural networks. The algorithm is tested on several function approximation problems, and is compared with a conjugate gradient algorithm and a variable learning rate algorithm. It is found that the Marquardt algorithm is much more efficient than either of the-other techniques when the network contains no more than a few hundred weights.
引用
收藏
页码：989 / 993
页数：5
相关论文
共 50 条
  • [31] Extended least squares based algorithm for training feedforward networks
    Yam, JYF
    Chow, TWS
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (03): : 806 - 810
  • [32] Training feedforward neural networks: An algorithm giving improved generalization
    Lee, CW
    [J]. NEURAL NETWORKS, 1997, 10 (01) : 61 - 68
  • [33] AN IMPROVED GENETIC ALGORITHM FOR TRAINING LAYERED FEEDFORWARD NEURAL NETWORKS
    刘平
    程翼宇
    [J]. Journal of Zhejiang University-Science A(Applied Physics & Engineering), 2000, (03) : 85 - 89
  • [34] A hybrid linear/nonlinear training algorithm for feedforward neural networks
    McLoone, S
    Brown, MD
    Irwin, G
    Lightbody, G
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 669 - 684
  • [35] A Second Order Training Algorithm for Multilayer Feedforward Neural Networks
    谭营
    何振亚
    邓超
    [J]. Journal of Southeast University(English Edition), 1997, (01) : 32 - 36
  • [36] A local linearized least squares algorithm for training feedforward neural networks
    Stan, O
    Kamen, E
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (02): : 487 - 495
  • [37] A fuzzy neighborhood-based training algorithm for feedforward neural networks
    Mounir Ben Nasr
    Mohamed Chtourou
    [J]. Neural Computing and Applications, 2009, 18 : 127 - 133
  • [38] Towards a Very Fast Feedforward Multilayer Neural Networks Training Algorithm
    Bilski, Jaroslaw
    Kowalczyk, Bartosz
    Kisiel-Dorohinicki, Marek
    Siwocha, Agnieszka
    Zurada, Jacek
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2022, 12 (03) : 181 - 195
  • [39] Training Feedforward Neural Networks Using an Enhanced Marine Predators Algorithm
    Zhang, Jinzhong
    Xu, Yubao
    [J]. PROCESSES, 2023, 11 (03)
  • [40] Training Feedforward Neural Networks Using Symbiotic Organisms Search Algorithm
    Wu, Haizhou
    Zhou, Yongquan
    Luo, Qifang
    Basset, Mohamed Abdel
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2016, 2016
12345