Neural Network Architecture Selection Using Particle Swarm Optimization Technique

被引:7
|
作者
Jamous, Razan [1 ]
ALRahhal, Hosam [1 ,2 ]
El-Darieby, Mohamed [1 ]
机构
[1] Univ Regina, Fac Engn & Appl Sci, Regina, SK, Canada
[2] Nahda Univ, Fac Engn, Bani Suwayf, Egypt
关键词
CLASSIFICATION; ALGORITHM;
D O I
10.1080/08839514.2021.1972251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finding the best structure of ANN to minimize errors, the processing and the search time is one of the main objectives in the AI field. In order to achieve prediction with a high degree of accuracy in a short time, an enhanced PSO-based selection technique to determine the optimal configuration for the artificial neural network has been proposed in this paper. To design the neural network to minimize processing time, search time and maximize the accuracy of prediction, it is necessary to identify hyperparameter values with precision. PSO with 2-D search space has been employed to select the best hyperparameters in order to construct the best neural network where PSO is used as a decision-making model and ANN is used as a learning model. The suggested technique was used to select the optimal number of the hidden layer and the number of units per hidden layer. The proposed technique was evaluated using a chemical dataset. The result of testing the proposed technique displayed high prediction accuracy with MSE equal to 3.9% and the relative error between the expected output and actual target is less than 1.6%. The results of the comparison of the proposed technique with the ANN showed that the proposed approach could predict output with an infinitesimal error, outperforming the existing ANN model in terms of error ratio.
引用
收藏
页码:1219 / 1236
页数:18
相关论文
共 50 条
  • [41] Neural network hyperparameter optimization based on improved particle swarm optimization①
    Xie, Xiaoyan
    He, Wanqi
    Zhu, Yun
    Yu, Jinhao
    [J]. High Technology Letters, 2023, 29 (04) : 427 - 433
  • [42] Neural network hyperparameter optimization based on improved particle swarm optimization
    谢晓燕
    HE Wanqi
    ZHU Yun
    YU Jinhao
    [J]. High Technology Letters, 2023, 29 (04) : 427 - 433
  • [43] Combustion Optimization Based on RBF Neural Network and Particle Swarm Optimization
    Wang Dongfeng
    Li Qindao
    Meng Li
    Han Pu
    [J]. SYSTEMS, ORGANIZATIONS AND MANAGEMENT: PROCEEDINGS OF THE 3RD WORKSHOP OF INTERNATIONAL SOCIETY IN SCIENTIFIC INVENTIONS, 2009, : 91 - 96
  • [44] Feature selection using double parallel feedforward neural networks and particle swarm optimization
    Huang, Rui
    He, Mingyi
    [J]. 2007 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-10, PROCEEDINGS, 2007, : 692 - 696
  • [45] A Novel Nonparametric Regression Ensemble for Rainfall Forecasting Using Particle Swarm Optimization Technique Coupled with Artificial Neural Network
    Wu, Jiansheng
    Chen, Enhong
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2009, PT 3, PROCEEDINGS, 2009, 5553 : 49 - +
  • [46] Particle swarm optimization using dimension selection methods
    Jin, Xin
    Liang, Yongquan
    Tian, Dongping
    Zhuang, Fuzhen
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2013, 219 (10) : 5185 - 5197
  • [47] Constrained Portfolio Selection using Particle Swarm Optimization
    Golmakani, Hamid Reza
    Fazel, Mehrshad
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (07) : 8327 - 8335
  • [48] Feature Selection for Classification Using Particle Swarm Optimization
    Brezocnik, Lucija
    [J]. 17TH IEEE INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES - IEEE EUROCON 2017 CONFERENCE PROCEEDINGS, 2017, : 966 - 971
  • [49] TEST FREQUENCY SELECTION USING PARTICLE SWARM OPTIMIZATION
    Kincl, Zdenek
    Kolka, Zdenek
    [J]. ADVANCES IN ELECTRICAL AND ELECTRONIC ENGINEERING, 2013, 11 (06) : 507 - 513
  • [50] Tag SNP Selection Using Particle Swarm Optimization
    Chuang, Li-Yeh
    Yang, Cheng-San
    Ho, Chang-Hsuan
    Yang, Cheng-Hong
    [J]. BIOTECHNOLOGY PROGRESS, 2010, 26 (02) : 580 - 588