Design of K-means clustering-based polynomial radial basis function neural networks (pRBF NNs) realized with the aid of particle swarm optimization and differential evolution

被引:55
|
作者
Oh, Sung-Kwun [1 ]
Kim, Wook-Dong [1 ]
Pedrycz, Witold [2 ,3 ]
Joo, Su-Chong [4 ]
机构
[1] Univ Suwon, Dept Elect Engn, Hwaseong Si 445743, Gyeonggi Do, South Korea
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2G6, Canada
[3] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
[4] Wonkwang Univ, Dept Comp Engn, Iksan 570749, Chon Buk, South Korea
基金
新加坡国家研究基金会;
关键词
Polynomial radial basis function neural networks (p-RBF NNs); K-means clustering; Particle swarm optimization; Differential evolution algorithm; Weighted least square estimation (WLSE); GRANULATION;
D O I
10.1016/j.neucom.2011.06.031
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we introduce an advanced architecture of K-means clustering-based polynomial Radial Basis Function Neural Networks (p-RBF NNs) designed with the aid of Particle Swarm Optimization (PSO) and Differential Evolution (DE) and develop a comprehensive design methodology supporting their construction. The architecture of the p-RBF NNs comes as a result of a synergistic usage of the evolutionary optimization-driven hybrid tools. The connections (weights) of the proposed p-RBF NNs being of a certain functional character and are realized by considering four types of polynomials. In order to design the optimized p-RBF NNs, a prototype (center value) of each receptive field is determined by running the K-means clustering algorithm and then a prototype and a spread of the corresponding receptive field are further optimized through running Particle Swarm Optimization (PSO) and Differential Evolution (DE). The Weighted Least Square Estimation (WLSE) is used to estimate the coefficients of the polynomials (which serve as functional connections of the network). The performance of the proposed model and the comparative analysis involving models designed with the aid of PSO and DE are presented in case of a nonlinear function and two Machine Learning (ML) datasets (C) 2011 Elsevier B.V. All rights reserved.
引用
收藏
页码:121 / 132
页数:12
相关论文
共 50 条
  • [1] Polynomial-based radial basis function neural networks (P-RBF NNs) realized with the aid of particle swarm optimization
    Oh, Sung-Kwun
    Kim, Wook-Dong
    Pedrycz, Witold
    Park, Byoung-Jun
    [J]. FUZZY SETS AND SYSTEMS, 2011, 163 (01) : 54 - 77
  • [2] Fuzzy Clustering-Based Polynomial Radial Basis Function Neural Networks (p-RBF NNs) Classifier Designed with Particle Swarm Optimization
    Kim, Wook-Dong
    Oh, Sung-Kwun
    Kim, Hyun-Ki
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT I, 2011, 6675 : 464 - 473
  • [3] Structural design of radial basis function-based polynomial neural networks by using multiobjective particle swarm optimization
    Kim, Wook-Dong
    Oh, Sung-Kwun
    [J]. Transactions of the Korean Institute of Electrical Engineers, 2012, 61 (01): : 135 - 142
  • [4] Design of hybrid radial basis function neural networks (HRBFNNs) realized with the aid of hybridization of fuzzy clustering method (FCM) and polynomial neural networks (PNNs)
    Huang, Wei
    Oh, Sung-Kwun
    Pedrycz, Witold
    [J]. NEURAL NETWORKS, 2014, 60 : 166 - 181
  • [5] Improved Particle Swarm Optimization based K-Means Clustering
    Prabha, K. Arun
    Visalakshi, N. Karthikayini
    [J]. 2014 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING APPLICATIONS (ICICA 2014), 2014, : 59 - 63
  • [6] K-Means Based Radial Basis Function Neural Networks for Rainfall Prediction
    Dubey, Akash Dutt
    [J]. 2015 INTERNATIONAL CONFERENCE ON TRENDS IN AUTOMATION, COMMUNICATIONS AND COMPUTING TECHNOLOGY (I-TACT-15), 2015,
  • [7] A New Algorithm for Clustering Based on Particle Swarm Optimization and K-means
    Dong, Jinxin
    Qi, Minyong
    [J]. 2009 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, VOL IV, PROCEEDINGS, 2009, : 264 - 268
  • [8] Analytic design of information granulation-based fuzzy radial basis function neural networks with the aid of multiobjective particle swarm optimization
    Park, Byoung-Jun
    Choi, Jeoung-Nae
    Kim, Wook-Dong
    Oh, Sung-Kwun
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2012, 5 (01) : 4 - 35
  • [9] Design of Polynomial Fuzzy Radial Basis Function Neural Networks Based on Nonsymmetric Fuzzy Clustering and Parallel Optimization
    Huang, Wei
    Wang, Jinsong
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
  • [10] An improved particle swarm optimization algorithm based k-means clustering analysis
    Wei, Benzheng
    Zhao, Zhimin
    [J]. Journal of Information and Computational Science, 2010, 7 (02): : 511 - 518