An adaptive learning algorithm aimed at improving RBF network generalization ability

被引:0
|
作者
Sun, J [1 ]
Shen, RM [1 ]
Yang, F [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai, Peoples R China
关键词
RBF network; generalization ability; regularization theory; statistics learning theory;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new adaptive learning algorithm of network structure aimed at improving RBF network generalization ability. The algorithm determines the initial number and center vectors of network hidden units by using forward selective clustering algorithm with decaying radius, and then adjusts them by using cluster sample transform algorithm based on impurity and variance and gets the final center vectors. The determination of widths of hidden units considers both the dispersivity of inner samples and the distance between clusters. Thus we get the final hidden structure. After determining the hidden structure, the back-propagation algorithm is used to train the weights between the hidden layer and output layer. The experiment of two spirals problem proves that our algorithm has higher generalization ability indeed.
引用
收藏
页码:363 / 373
页数:11
相关论文
共 50 条
  • [21] An exploration of the uncertainty relation satisfied by BP network learning ability and generalization ability
    Li, ZY
    Peng, LH
    [J]. SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2004, 47 (02): : 137 - 150
  • [22] An exploration of the uncertainty relation satisfied by BP network learning ability and generalization ability
    Zuoyong Li
    Lihong Peng
    [J]. Science in China Series F: Information Sciences, 2004, 47 : 137 - 150
  • [23] A learning algorithm for enhancing the generalization ability of support vector machines
    Guo, J
    Takahashi, N
    Nishi, T
    [J]. 2005 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), VOLS 1-6, CONFERENCE PROCEEDINGS, 2005, : 3631 - 3634
  • [24] Adaptive Learning Algorithm for RBF Neural Networks in Kernel Spaces
    Pazouki, Maryam
    Allaei, Sonia Seyed
    Pazouki, M. Hossein
    Moeller, Dietmar P. F.
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 4811 - 4818
  • [25] RBF Neural Network Based on T-S Fuzzy Model Adaptive Learning Algorithm and Application
    Zheng, Bowen
    Zhong, Mengchun
    Mao, Baoquan
    [J]. PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 1084 - 1088
  • [26] IMPROVING THE GENERALIZATION ABILITY OF DEEPFAKE DETECTION VIA DISENTANGLED REPRESENTATION LEARNING
    Hu, Jiashang
    Wang, Shilin
    Li, Xiaoyong
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3577 - 3581
  • [27] A New Early Stopping Algorithm for Improving Neural Network Generalization
    Wu, Xing-xing
    Liu, Jin-guo
    [J]. ICICTA: 2009 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION, VOL I, PROCEEDINGS, 2009, : 15 - 18
  • [28] Generalization ability of Universal Learning Network by optimizing network size and time delay
    Han, M
    Ohbayashi, M
    Hirasawa, K
    Murata, J
    Hu, JL
    [J]. PROGRESS IN CONNECTIONIST-BASED INFORMATION SYSTEMS, VOLS 1 AND 2, 1998, : 371 - 374
  • [29] Q-Learning Algorithm Based on Incremental RBF Network
    Hu, Yanming
    Li, Decai
    He, Yuqing
    Han, Jianda
    [J]. Jiqiren/Robot, 2019, 41 (05): : 562 - 573
  • [30] A Fast Robust Learning Algorithm for RBF Network Against Outliers
    Su, Mei-juan
    Deng, Wei
    [J]. INTELLIGENT COMPUTING, PART I: INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING, ICIC 2006, PART I, 2006, 4113 : 280 - 285