Gradient-Newton learning algorithm for feedforward neural netwoks

被引:0
|
作者
Liang, JZ [1 ]
He, XG [1 ]
Huang, DS [1 ]
机构
[1] Beijing Univ Aeronaut & Astronaut, Dept Comp Sci & Engn, Beijing 100083, Peoples R China
关键词
feedforward neural networks; BP learning algorithm; gradient algorithm; Newton algorithm; convergence;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose a new kind of Gradient-Newton learning algorithm for feedforward neural networks based on two different forms of error function. In this algorithm we take the advantage of gradient algorithm for its fast speed in the first stage of learning. After that we use Newton iteration algorithm in its convergence domain based on another error function. It needs only to compute the first order of difference in our algorithm, so it has lower computational complexity ann has fast learning speed Finally, we give two computing examples.
引用
收藏
页码:2870 / 2874
页数:5
相关论文
共 50 条
  • [1] The Parallel Approach to the Conjugate Gradient Learning Algorithm for the Feedforward Neural Networks
    Bilski, Jaroslaw
    Smolag, Jacek
    Galushkin, Alexander I.
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING ICAISC 2014, PT I, 2014, 8467 : 12 - 21
  • [2] Greedy Projected Gradient-Newton Method for Sparse Logistic Regression
    Wang, Rui
    Xiu, Naihua
    Zhang, Chao
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (02) : 527 - 538
  • [3] Semi-Blind Gradient-Newton CMA and SDD Algorithm for MIMO Space-Time Equalisation
    Chen, S.
    Hanzo, L.
    Cheng, H-T.
    [J]. GLOBECOM 2009 - 2009 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-8, 2009, : 5520 - 5524
  • [4] A parallel algorithm for gradient training of feedforward neural networks
    Hanzalek, Z
    [J]. PARALLEL COMPUTING, 1998, 24 (5-6) : 823 - 839
  • [5] A novel learning algorithm for feedforward neural networks
    Chen, Huawei
    Jin, Fan
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 509 - 514
  • [6] A new learning algorithm for feedforward neural networks
    Liu, DR
    Chang, TS
    Zhang, Y
    [J]. PROCEEDINGS OF THE 2001 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL (ISIC'01), 2001, : 39 - 44
  • [7] An efficient learning algorithm for feedforward neural network
    Tan, SB
    Gu, J
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE - IBERAMIA 2004, 2004, 3315 : 767 - 777
  • [9] A FAST AND ROBUST LEARNING ALGORITHM FOR FEEDFORWARD NEURAL NETWORKS
    WEYMAERE, N
    MARTENS, JP
    [J]. NEURAL NETWORKS, 1991, 4 (03) : 361 - 369
  • [10] A general backpropagation algorithm for feedforward neural networks learning
    Yu, XH
    Efe, MO
    Kaynak, O
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (01): : 251 - 254