An adaptive learning algorithm aimed at improving RBF network generalization ability

被引:0
|
作者
Sun, J [1 ]
Shen, RM [1 ]
Yang, F [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
关键词
RBF network; generalization ability; regularization theory; statistics learning theory;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new adaptive learning algorithm of network structure aimed at improving RBF network generalization ability. The algorithm determines the initial number and center vectors of network hidden units by using forward selective clustering algorithm with decaying radius, and then adjusts them by using cluster sample transform algorithm based on impurity and variance and gets the final center vectors. The determination of widths of hidden units considers both the dispersivity of inner samples and the distance between clusters. Thus we get the final hidden structure. After determining the hidden structure, the back-propagation algorithm is used to train the weights between the hidden layer and output layer. The experiment of two spirals problem proves that our algorithm has higher generalization ability indeed.
引用
收藏
页码:363 / 373
页数:11
相关论文
共 50 条
  • [1] A new adaptive RBF network structure learning algorithm
    Sun, J
    Shen, RM
    Yang, F
    [J]. 2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 35 - 40
  • [2] IMPROVING A NETWORK GENERALIZATION ABILITY BY SELECTING EXAMPLES
    KINZEL, W
    RUJAN, P
    [J]. EUROPHYSICS LETTERS, 1990, 13 (05): : 473 - 477
  • [3] Improving generalization ability through active learning
    Vijayakumar, S
    Ogawa, H
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 1999, E82D (02) : 480 - 487
  • [4] GENERALIZATION ABILITY OF FEEDFORWARD NEURAL NETWORK TRAINED BY FAHLMAN AND LEBIERE LEARNING ALGORITHM
    HAMAMOTO, M
    KAMRUZZAMAN, J
    KUMAGAI, Y
    HIKITA, H
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1992, E75A (11) : 1597 - 1601
  • [5] A global learning algorithm for a RBF network
    Zhu, QM
    Cai, Y
    Liu, LZ
    [J]. NEURAL NETWORKS, 1999, 12 (03) : 527 - 540
  • [6] AN ACTOR-CRITIC REINFORCEMENT LEARNING ALGORITHM BASED ON ADAPTIVE RBF NETWORK
    Li, Chun-Gui
    Wang, Meng
    Huang, Zhen-Jin
    Zhang, Zeng-Fang
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 984 - 988
  • [7] Adaptive Computation Algorithm for RBF Neural Network
    Han, Hong-Gui
    Qiao, Jun-Fei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (02) : 342 - 347
  • [8] INCREMENTAL LEARNING AND GENERALIZATION ABILITY OF ARTIFICIAL NEURAL NETWORK TRAINED BY FAHLMAN AND LEBIERE LEARNING ALGORITHM
    HAMAMOTO, M
    KAMRUZZAMAN, J
    KUMAGAI, Y
    HIKITA, H
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1993, E76A (02) : 242 - 247
  • [9] Deterministic annealing learning of the radial basis function nets for improving the regression ability of RBF network
    Zheng, NN
    Zhang, ZH
    Zheng, HB
    Gang, S
    [J]. IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL III, 2000, : 601 - 607
  • [10] A Recurrent RBF Neural Network Based on Adaptive Optimum Steepest Descent Learning Algorithm
    Ma, Shijie
    Yang, Chili
    Qiao, Junfei
    [J]. PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 3942 - 3947