Gradient learning algorithm for ensembling neural network

被引:0
|
作者
Meng, Jiang [1 ]
An, Kun [2 ]
机构
[1] North Univ China, Sch Mech Engn & Automatizat, Taiyuan 030051, Peoples R China
[2] North Univ China, Sch Informat & Commun Engn, Taiyuan 030051, Peoples R China
关键词
neural network ensemble; gradient descent; generalization performance; GASEN;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aimed at similarity between neural network ensemble and simple neural network, a novel gradient learning algorithm for ensemble (GLAENN) is presented based on the gradient descent method. The new algorithm can improve the generalization error by modifying subnet weights after the ensemble subnets are trained individually. The simulation results indicate GLAENN is of similar function to GASEN but with a different idea; further, it is of better generalization performance than GASEN, bagging and single network.
引用
收藏
页码:1658 / +
页数:2
相关论文
共 50 条
  • [1] Star algorithm for neural network ensembling
    Zinchenko, Sergey
    Lishudi, Dmitrii
    [J]. NEURAL NETWORKS, 2024, 170 : 364 - 375
  • [2] Accelerated gradient learning algorithm for neural network weights update
    Hocenski, Zeljko
    Antunoviae, Mladen
    Filko, Damir
    [J]. NEURAL COMPUTING & APPLICATIONS, 2010, 19 (02): : 219 - 225
  • [3] Accelerated gradient learning algorithm for neural network weights update
    Željko Hocenski
    Mladen Antunoviæ
    Damir Filko
    [J]. Neural Computing and Applications, 2010, 19 : 219 - 225
  • [4] Hybrid hyperplane gradient learning algorithm for RBF neural network
    Ma, Miao-li
    Huang, Zhe-kun
    Liao, Yu-hang
    Zhou, Li-yi
    Jia, Li-jie
    Liang, Cun-zhen
    Guo, Zhi-jun
    [J]. NEUROCOMPUTING, 2024, 587
  • [5] Accelerated gradient learning algorithm for neural network weights update
    Hocenski, Zeljko
    Antunovic, Mladen
    Filko, Damir
    [J]. KNOWLEDGE - BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 1, PROCEEDINGS, 2008, 5177 : 49 - 56
  • [6] ACORg: A Gradient-Guided ACO Algorithm for Neural Network Learning
    Abdelbar, Ashraf M.
    Salama, Khalid M.
    [J]. 2015 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2015, : 1133 - 1140
  • [7] An analysis of learning algorithm for layered neural network with coupled gradient descent method
    Isokawa, T
    Matsui, N
    [J]. 8TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING, VOLS 1-3, PROCEEDING, 2001, : 751 - 754
  • [8] Accelerated gradient algorithm for RBF neural network
    Han, Hong-Gui
    Ma, Miao-Li
    Qiao, Jun-Fei
    [J]. NEUROCOMPUTING, 2021, 441 : 237 - 247
  • [9] The natural gradient learning algorithm for neural networks
    Amari, S
    [J]. THEORETICAL ASPECTS OF NEURAL COMPUTATION: A MULTIDISCIPLINARY PERSPECTIVE, 1998, : 1 - 15
  • [10] An Adaptive Fuzzy Wavelet Neural Network with Gradient Learning Algorithm For Nonlinear Function Approximation
    Oysal, Yusuf
    Yilmaz, Sevcan
    [J]. 2013 10TH IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC), 2013, : 152 - 157