Neural Network Architecture Selection Using Particle Swarm Optimization Technique

被引:7
|
作者
Jamous, Razan [1 ]
ALRahhal, Hosam [1 ,2 ]
El-Darieby, Mohamed [1 ]
机构
[1] Univ Regina, Fac Engn & Appl Sci, Regina, SK, Canada
[2] Nahda Univ, Fac Engn, Bani Suwayf, Egypt
关键词
CLASSIFICATION; ALGORITHM;
D O I
10.1080/08839514.2021.1972251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finding the best structure of ANN to minimize errors, the processing and the search time is one of the main objectives in the AI field. In order to achieve prediction with a high degree of accuracy in a short time, an enhanced PSO-based selection technique to determine the optimal configuration for the artificial neural network has been proposed in this paper. To design the neural network to minimize processing time, search time and maximize the accuracy of prediction, it is necessary to identify hyperparameter values with precision. PSO with 2-D search space has been employed to select the best hyperparameters in order to construct the best neural network where PSO is used as a decision-making model and ANN is used as a learning model. The suggested technique was used to select the optimal number of the hidden layer and the number of units per hidden layer. The proposed technique was evaluated using a chemical dataset. The result of testing the proposed technique displayed high prediction accuracy with MSE equal to 3.9% and the relative error between the expected output and actual target is less than 1.6%. The results of the comparison of the proposed technique with the ANN showed that the proposed approach could predict output with an infinitesimal error, outperforming the existing ANN model in terms of error ratio.
引用
收藏
页码:1219 / 1236
页数:18
相关论文
共 50 条
  • [1] Feature Selection of Diabetic Retinopathy Disease Using Particle Swarm Optimization and Neural Network
    Herliana, Asti
    Arifin, Toni
    Susanti, Sari
    Hikmah, Agung Baitul
    [J]. 2018 6TH INTERNATIONAL CONFERENCE ON CYBER AND IT SERVICE MANAGEMENT (CITSM), 2018, : 128 - 131
  • [2] Improved Cluster Head Selection Using Particle Swarm Optimization and Neural Network in WSN
    Mishra, Komal
    Sharma, Pooja
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMPUTING SCIENCES (ICCS 2021), 2021, : 13 - 18
  • [3] Control Of An Airship Using Particle Swarm Optimization and Neural Network
    Jia, Ruting
    Frye, Michael T.
    Qian, Chunjiang
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 1809 - +
  • [4] Designing optimal architecture of recurrent neural network (LSTM) with particle swarm optimization technique specifically for educational dataset
    Chhachhiya D.
    Sharma A.
    Gupta M.
    [J]. International Journal of Information Technology, 2019, 11 (1) : 159 - 163
  • [5] Automatic Business Location Selection through Particle Swarm Optimization and Neural Network
    Luo, Yinyi
    Zhong, Jinghui
    Liu, Wei-Li
    Chen, Wei-Neng
    [J]. 2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI, 2023,
  • [6] Using the particle swarm optimization technique to train a recurrent neural model
    Salerno, J
    [J]. NINTH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 1997, : 45 - 49
  • [7] DIAGNOSIS OF SLEEP APNEA USING ARTIFICIAL NEURAL NETWORK AND BINARY PARTICLE SWARM OPTIMIZATION FOR FEATURE SELECTION
    Surani, Salim
    Sheta, Alaa
    Turabieh, Hamza
    Park, Jangwoon
    Mathur, Sunil
    Katangur, Ajay
    [J]. CHEST, 2019, 156 (04) : 136A - 136A
  • [8] Neural Architecture Search Based on Particle Swarm Optimization
    Niu, Ruicheng
    Li, Hao
    Zhang, Yachuan
    Kang, Yan
    [J]. 2019 3RD INTERNATIONAL CONFERENCE ON DATA SCIENCE AND BUSINESS ANALYTICS (ICDSBA 2019), 2019, : 319 - 324
  • [9] Neural Network Training Using Particle Swarm Optimization - a Case Study
    Kaminski, Marcin
    [J]. 2019 24TH INTERNATIONAL CONFERENCE ON METHODS AND MODELS IN AUTOMATION AND ROBOTICS (MMAR), 2019, : 115 - 120
  • [10] Integration of particle swarm optimization-based fuzzy neural network and artificial neural network for supplier selection
    Kuo, R. J.
    Hong, S. Y.
    Huang, Y. C.
    [J]. APPLIED MATHEMATICAL MODELLING, 2010, 34 (12) : 3976 - 3990