TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM

被引：5416
|
作者：
HAGAN, MT
MENHAJ, MB
机构：
来源：
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1994年 / 5卷 / 06期
关键词：
D O I：
10.1109/72.329697
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The Marquardt algorithm for nonlinear least squares is presented and is incorporated into the backpropagation algorithm for training feedforward neural networks. The algorithm is tested on several function approximation problems, and is compared with a conjugate gradient algorithm and a variable learning rate algorithm. It is found that the Marquardt algorithm is much more efficient than either of the-other techniques when the network contains no more than a few hundred weights.
引用
收藏
页码：989 / 993
页数：5
相关论文
共 50 条
  • [1] Levenberg-Marquardt algorithm with adaptive momentum for the efficient training of feedforward networks
    Ampazis, N
    Perantonis, SJ
    [J]. IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL I, 2000, : 126 - 131
  • [2] Fast Computational Approach to the Levenberg-Marquardt Algorithm for Training Feedforward Neural Networks
    Bilski, Jaroslaw
    Smolag, Jacek
    Kowalczyk, Bartosz
    Grzanek, Konrad
    Izonin, Ivan
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING RESEARCH, 2023, 13 (02) : 45 - 61
  • [3] A New Levenberg-Marquardt Algorithm for feedforward neural networks
    Li, Yanlai
    Wang, Kuanquan
    Li, Tao
    [J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 3516 - 3519
  • [4] Parallel Approach to the Levenberg-Marquardt Learning Algorithm for Feedforward Neural Networks
    Bilski, Jaroslaw
    Smolag, Jacek
    Zurada, Jacek M.
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, PT I, 2015, 9119 : 3 - 14
  • [5] Efficient computation of the Levenberg-Marquardt algorithm for feedforward networks with linear outputs
    de Chazal, Philip
    McDonnell, Mark D.
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 68 - 75
  • [6] A hybrid training algorithm for feedforward neural networks
    Ben Nasr, Mounir
    Chtourou, Mohamed
    [J]. NEURAL PROCESSING LETTERS, 2006, 24 (02) : 107 - 117
  • [7] AN EFFICIENT CONSTRAINED TRAINING ALGORITHM FOR FEEDFORWARD NETWORKS
    KARRAS, DA
    PERANTONIS, SJ
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (06): : 1420 - 1434
  • [8] A TRAINING ALGORITHM FOR BINARY FEEDFORWARD NEURAL NETWORKS
    GRAY, DL
    MICHEL, AN
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (02): : 176 - 194
  • [9] A Hybrid Training Algorithm for Feedforward Neural Networks
    Mounir Ben Nasr
    Mohamed Chtourou
    [J]. Neural Processing Letters, 2006, 24 : 107 - 117
  • [10] Properties of a Batch Training Algorithm for Feedforward Networks
    Melvin D. Robinson
    Michael T. Manry
    Sanjeev S. Malalur
    Changhua Yu
    [J]. Neural Processing Letters, 2017, 45 : 841 - 854
12345