An improved artificial neural network based on human-behaviour particle swarm optimization and cellular automata

被引:24
|
作者
Wang, Yue [1 ]
Liu, Hao [1 ]
Yu, ZhongXin [2 ]
Tu, LiangPing [1 ]
机构
[1] Univ Sci & Technol Liaoning, Sch Sci, Anshan 114051, Peoples R China
[2] Univ Sci & Technol Liaoning, Sch Mater & Metalllurgy, Anshan 114051, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial neural networks; Weight training; Human behavior-based particle swarm optimization; Cellular automata; EA-based ANN models; GLOBAL OPTIMIZATION; ALGORITHMS; ANN;
D O I
10.1016/j.eswa.2019.112862
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Back-Propagation (BP) neural network, as a powerful and adaptive tool, has led to a tremendous surge in various expert systems. However, BP model has some deficiencies such as getting trapped in local minima and premature convergence. These weaknesses can be partly compensated by combining the ANN with Evolutionary Algorithms (EAs), i.e., at the same time, EAs also sufferred from their own characteristics, such as premature convergence in Particle Swarm Optimization (PSO). To gain a better trained weights in EAs-ANN, this paper proposes an improved ANN model based on HPSO and Cellular Automata (CA), which is called ANN-HPSO-CA. Firstly, to balance global exploration and local exploitation better and prevent particles from trapping in local optima, CA strategy is involved in HPSO algorithm, which is denoted as HPSO-CA. Then, the proposed HPSO-CA algorithm is combined with ANN to prevent ANN from trapping in local minima. Finally, to validate the performance of ANN-HPSO-CA, 15 benchmark complex and real-world datasets are used to compare with some well-known EA-based ANN models. Experimental results confirm that the proposed ANN-HPSO-CA algorithm outperforms the other predictive EA-based ANN models. The numerical comparison results will provide useful information and references for any future study for choosing proper EAs as ANN training algorithms. In addition, ANN-HPSO-CA algorithm provides a good theoretical basis for an expert system with good convergence and robustness. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Improved Particle Swarm Optimization Based on Chaotic Cellular Automata
    Barani, Milad Jafari
    Ayubi, Peyman
    Hadi, Reza Mahdi
    [J]. 2014 IRANIAN CONFERENCE ON INTELLIGENT SYSTEMS (ICIS), 2014,
  • [2] Neural network hyperparameter optimization based on improved particle swarm optimization①
    Xie, Xiaoyan
    He, Wanqi
    Zhu, Yun
    Yu, Jinhao
    [J]. High Technology Letters, 2023, 29 (04) : 427 - 433
  • [3] Neural network hyperparameter optimization based on improved particle swarm optimization
    谢晓燕
    HE Wanqi
    ZHU Yun
    YU Jinhao
    [J]. High Technology Letters, 2023, 29 (04) : 427 - 433
  • [4] An improved particle swarm optimisation based on cellular automata
    Dai, Yuntao
    Liu, Liqiang
    Li, Ying
    Song, Jingyi
    [J]. INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND MATHEMATICS, 2014, 5 (01) : 94 - 106
  • [5] A new evolved artificial neural network based on particle swarm optimization
    Zhang, GY
    Sha, Y
    Zhang, J
    [J]. ISTM/2005: 6TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-9, CONFERENCE PROCEEDINGS, 2005, : 9347 - 9349
  • [6] An improved particle swarm optimization based training algorithm for neural network
    Zhao, FQ
    Hong, Y
    Yu, DM
    Yang, YH
    [J]. ICMIT 2005: INFORMATION SYSTEMS AND SIGNAL PROCESSING, 2005, 6041
  • [7] An Improved Particle Swarm Optimization based Neural Network Training for Classification
    Mondal, Palash
    Nandi, Arijit
    Jana, Nanda Dulal
    [J]. PROCEEDINGS OF 2019 IEEE REGION 10 SYMPOSIUM (TENSYMP), 2019, : 681 - 686
  • [8] Improved Particle Swarm Optimization-Based Artificial Neural Network for Rainfall-Runoff Modeling
    Asadnia, Mohsen
    Chua, Lloyd H. C.
    Qin, X. S.
    Talei, Amin
    [J]. JOURNAL OF HYDROLOGIC ENGINEERING, 2014, 19 (07) : 1320 - 1329
  • [9] The Simulation and Improvement of Particle Swarm Optimization Based on Cellular Automata
    Yu Fengxia
    Li Gang
    [J]. 2012 INTERNATIONAL WORKSHOP ON INFORMATION AND ELECTRONICS ENGINEERING, 2012, 29 : 1113 - 1118
  • [10] Particle Swarm Optimization Algorithm Based Artificial Neural Network for Botnet Detection
    P. Panimalar
    [J]. Wireless Personal Communications, 2021, 121 : 2655 - 2666