A robust evolutionary algorithm for training neural networks

被引:55
|
作者
Yang, JM [1 ]
Kao, CY
机构
[1] Natl Chiao Tung Univ, Dept Biol Sci & Technol, Hsinchu, Taiwan
[2] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 10764, Taiwan
来源
NEURAL COMPUTING & APPLICATIONS | 2001年 / 10卷 / 03期
关键词
adaptive mutations; evolutionary algorithm; family competition; multiple mutations; neural networks;
D O I
10.1007/s521-001-8050-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new evolutionary algorithm is introduced for training both feedforward and recurrent neural networks. The proposed approach, called the Family Competition Evolutionary Algorithm (FCEA), automatically achieves the balance of the solution quality and convergence speed by integrating multiple mutations, family competition and adaptive rides. We experimentally analyse the proposed approach by, showing that its components can cooperate with one another, and possess good local and global properties. Following the description of implementation details, our approach is then applied to several benchmark problems, including an artificial ant problem, parity problems and a two-spiral problem. Experimental results indicate that the new approach is able to stably solve these problems, and is very competitive with the comparative evolutionary algorithms.
引用
收藏
页码:214 / 230
页数:17
相关论文
共 50 条
  • [1] A Robust Evolutionary Algorithm for Training Neural Networks
    Jinn-Moon Yang
    Cheng-Yan Kao
    [J]. Neural Computing & Applications, 2001, 10 : 214 - 230
  • [2] Convergence analysis of a segmentation algorithm for the evolutionary training of neural networks
    Hüning, H
    [J]. 2000 IEEE SYMPOSIUM ON COMBINATIONS OF EVOLUTIONARY COMPUTATION AND NEURAL NETWORKS, 2000, : 70 - 81
  • [3] Leap-frog is a robust algorithm for training neural networks
    Holm, JEW
    Botha, EC
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1999, 10 (01) : 1 - 13
  • [4] Evolutionary algorithms for training neural networks
    Mohan, Chilukuri K.
    [J]. MODELING AND SIMULATION FOR MILITARY APPLICATIONS, 2006, 6228
  • [5] Evolutionary Algorithm for Training Compact Single Hidden Layer Feedforward Neural Networks
    Huynh, Hieu Trung
    Won, Yonggwan
    [J]. 2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 3028 - 3033
  • [6] Robust algorithm for neural network training
    Manic, M
    Wilamowski, B
    [J]. PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 1528 - 1533
  • [7] Robust training algorithm of multilayered neural networks for identification of nonlinear dynamic systems
    Song, Q
    [J]. IEE PROCEEDINGS-CONTROL THEORY AND APPLICATIONS, 1998, 145 (01): : 41 - 46
  • [8] Evolutionary Design and Training of Artificial Neural Networks
    Kojecky, Lumir
    Zelinka, Ivan
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 427 - 437
  • [9] An evolutionary building algorithm for Deep Neural Networks
    Zemouri, Ryad
    [J]. 2017 12TH INTERNATIONAL WORKSHOP ON SELF-ORGANIZING MAPS AND LEARNING VECTOR QUANTIZATION, CLUSTERING AND DATA VISUALIZATION (WSOM), 2017, : 21 - 27
  • [10] AN EVOLUTIONARY ALGORITHM THAT CONSTRUCTS RECURRENT NEURAL NETWORKS
    ANGELINE, PJ
    SAUNDERS, GM
    POLLACK, JB
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (01): : 54 - 65