Feed Forward Neural Network optimization by Particle Swarm Intelligence

被引:1
|
作者
Hajare, Pratik R. [1 ]
Bawane, Narendra G. [2 ]
机构
[1] GH Raisoni Coll Engn, Nagpur, Maharashtra, India
[2] SB Jain Inst Technol Management & Res, Nagpur, Maharashtra, India
关键词
Particle swarm intelligence; feed forward Neural Network; Backpropagation; convergence; benchmark; realistic problems; prediction error; local minima; local maxima; CONVERGENCE; ALGORITHM;
D O I
10.1109/ICETET.2015.46
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper is based on feed forward neural network (FFNN) optimization by particle swarm intelligence (PSI) used at the starting point of neural network for initial guess to weights and biases. Once the weights and biases are found, the same are used to train the neural network for prediction and classification benchmark problems. Further the trained neural network is the used to predict future sample and classify the test samples. A comparison is made between normal FFNN with random weights and biases and FFNN with particle swarm optimized weights and biases. Four such benchmark databases are considered in this paper, The Mackey Series, Box Jenkins Database, Breast Cancer Database and the Diabetic Database. Result shows that neural network performs better with initial weights and biases obtained by Particle Swarm optimization. The tendency of back propagation to stuck at local minima and local maxima thus can be overcome, and the network converges faster. Also the prediction error is minimized and classification accuracy is increased.
引用
下载
收藏
页码:40 / 45
页数:6
相关论文
共 50 条
  • [1] A Hybrid Particle Swarm Optimization for Feed-Forward Neural Network Training
    Niu, Ben
    Li, Li
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, PROCEEDINGS: WITH ASPECTS OF ARTIFICIAL INTELLIGENCE, 2008, 5227 : 494 - 501
  • [2] A hybrid particle swarm algorithm for the structure and parameters optimization of feed-forward neural network
    Tang Xian-Lun
    Li Yin-Guo
    Ling, Zhuang
    ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 3, PROCEEDINGS, 2007, 4493 : 213 - +
  • [3] A hybrid blind signal separation algorithm: Particle swarm optimization on feed-forward neural network
    Liu, Chan-Cheng
    Sun, Tsung-Ying
    Hsieh, Sheng-Ta
    Lin, Chun-Ling
    Lee, Kan-Yuan
    NEURAL INFORMATION PROCESSING, PT 1, PROCEEDINGS, 2006, 4232 : 1078 - 1087
  • [4] Hybrid training of feed-forward neural networks with particle swarm optimization
    Carvalho, M.
    Ludermir, T. B.
    NEURAL INFORMATION PROCESSING, PT 2, PROCEEDINGS, 2006, 4233 : 1061 - 1070
  • [5] The application of particle swarm optimization algorithm in training Forward Neural Network
    Song Shao-zhong
    Zhang Li-biao
    Shu-hua
    SNPD 2007: EIGHTH ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING, AND PARALLEL/DISTRIBUTED COMPUTING, VOL 2, PROCEEDINGS, 2007, : 455 - +
  • [6] A Novel Multimean Particle Swarm Optimization Algorithm for Nonlinear Continuous Optimization: Application to Feed-Forward Neural Network Training
    Hacibeyoglu, Mehmet
    Ibrahim, Mohammed H.
    SCIENTIFIC PROGRAMMING, 2018, 2018
  • [7] Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization
    Zhang, Yudong
    Wu, Lenan
    SENSORS, 2011, 11 (05) : 4721 - 4743
  • [8] An improved particle swarm optimization-based feed-forward neural network combined with RFID sensors to indoor localization
    Wang C.
    Shi Z.
    Wu F.
    Shi, Zhicai (shizhicai@sues.edu.cn), 1600, MDPI AG (08):
  • [9] Evolutionary design of feed-forward neural network based on species niching particle swarm optimizer
    Wang, J.-N. (wangjunnian@sina.com), 2005, Northeast University (20):
  • [10] Combining a gravitational search algorithm, particle swarm optimization, and fuzzy rules to improve the classification performance of a feed-forward neural network
    Huang, Mei-Ling
    Chou, Yueh-Ching
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2019, 180