Gradient learning algorithm for ensembling neural network

被引:0
|
作者
Meng, Jiang [1 ]
An, Kun [2 ]
机构
[1] North Univ China, Sch Mech Engn & Automatizat, Taiyuan 030051, Peoples R China
[2] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Peoples R China
关键词
neural network ensemble; gradient descent; generalization performance; GASEN;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aimed at similarity between neural network ensemble and simple neural network, a novel gradient learning algorithm for ensemble (GLAENN) is presented based on the gradient descent method. The new algorithm can improve the generalization error by modifying subnet weights after the ensemble subnets are trained individually. The simulation results indicate GLAENN is of similar function to GASEN but with a different idea; further, it is of better generalization performance than GASEN, bagging and single network.
引用
收藏
页码:1658 / +
页数:2
相关论文
共 50 条
  • [21] The Learning Algorithm for a Novel Fuzzy Neural Network
    Liu, Puyin
    Luo, Qiang
    Yang, Wenqiang
    Yi, Dongyun
    [J]. INTELLIGENT COMPUTING, PART I: INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING, ICIC 2006, PART I, 2006, 4113 : 247 - 258
  • [22] LEARNING PERCEPTRON NEURAL NETWORK WITH BACKPROPAGATION ALGORITHM
    Ruxanda, Gheorghe
    [J]. ECONOMIC COMPUTATION AND ECONOMIC CYBERNETICS STUDIES AND RESEARCH, 2010, 44 (04): : 37 - 54
  • [23] Restoring images using a feed-forward neural network and the gradient adaptive learning rate algorithm
    Atta, AYE
    Haarb, HM
    [J]. JOURNAL OF MODERN OPTICS, 1998, 45 (11) : 2301 - 2313
  • [24] A recalling-enhanced recurrent neural network: Conjugate gradient learning algorithm and its convergence analysis
    Gao, Tao
    Gong, Xiaoling
    Zhang, Kai
    Lin, Feng
    Wang, Jian
    Huang, Tingwen
    Zurada, Jacek M.
    [J]. INFORMATION SCIENCES, 2020, 519 (273-288) : 273 - 288
  • [25] Learning algorithm for Pulse Coupled Neural Network
    Calvin, P
    Yuen, G
    Boddruzzaman, M
    Malkani, M
    [J]. THIRTIETH SOUTHEASTERN SYMPOSIUM ON SYSTEM THEORY (SSST), 1998, : 407 - 411
  • [26] An effective learning algorithm of Synergetic Neural Network
    Ma, XL
    Jiao, LC
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2004, PT 1, 2004, 3173 : 258 - 263
  • [27] An adaptive learning algorithm for a wavelet neural network
    Bodyanskiy, Y
    Lamonova, N
    Pliss, I
    Vynokurova, O
    [J]. EXPERT SYSTEMS, 2005, 22 (05) : 235 - 240
  • [28] An Alternative Fast Learning Algorithm of Neural Network
    Weng, Pin-Hsuan
    Huang, Chih-Chien
    Chen, Yu-Ju
    Huang, Huang-Chu
    Hwang, Rey-Chue
    [J]. SIXTH INTERNATIONAL SYMPOSIUM ON NEURAL NETWORKS (ISNN 2009), 2009, 56 : 205 - +
  • [29] A tabu based neural network learning algorithm
    Ye, Jian
    Qiao, Junfei
    Li, Ming-ai
    Ruan, Xiaogang
    [J]. NEUROCOMPUTING, 2007, 70 (4-6) : 875 - 882
  • [30] Learning algorithm study of adaptive neural network
    Lei, Ming
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering & Electronics, 1994, 16 (03):