A novel hybrid multilayer perceptron neural network with improved grey wolf optimizer

被引:15
|
作者
Altay, Osman [1 ]
Altay, Elif Varol [1 ]
机构
[1] Celal Bayar Univ, Dept Software Engn, Manisa, Turkey
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 01期
关键词
Improved grey wolf optimizer; Multilayer perceptron; Training neural network; Evolutionary algorithm; Evolving neural network; ALGORITHM; EVOLUTIONARY;
D O I
10.1007/s00521-022-07775-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The multilayer perceptron (MLP), a type of feed-forward neural network, is widely used in various artificial intelligence problems in the literature. Backpropagation is the most common learning method used in MLPs. The gradient-based backpropagation method, which is one of the classical methods, has some disadvantages such as entrapment in local minima, convergence speed, and initialization sensitivity. To eliminate or minimize these disadvantages, there are many studies in the literature that use metaheuristic optimization methods instead of classical methods. These methods are constantly being developed. One of these is an improved grey wolf optimizer (IMP-GWO) proposed to eliminate the disadvantages of the grey wolf optimizer (GWO), which suffers from a lack of search agent diversity, premature convergence, and imbalance between exploitation and exploration. In this study, a new hybrid method, IMP-GWO-MLP, machine learning method was designed for the first time by combining IMP-GWO and MLP. IMP-GWO was used to determine the weight and bias values, which are the most challenging parts of the MLP training phase. The proposed IMP-GWO-MLP was applied to 20 datasets consisting of three different approximations, eight regression problems, and nine classification problems. The results obtained have been suggested in the literature and compared with the gradient descent-based MLP, commonly used GWO, particle swarm optimization, whale optimization algorithm, ant lion algorithm, and genetic algorithm-based MLP methods. The experimental results show that the proposed method is superior to other state-of-the-art methods in the literature. In addition, it is thought that the proposed method can be modeled with high success in real-world problems.
引用
收藏
页码:529 / 556
页数:28
相关论文
共 50 条
  • [1] A novel hybrid multilayer perceptron neural network with improved grey wolf optimizer
    Osman Altay
    Elif Varol Altay
    [J]. Neural Computing and Applications, 2023, 35 : 529 - 556
  • [2] Grey Wolf Optimizer for Training Elman Neural Network
    Rabhi, Besma
    Dhahri, Habib
    Alimi, Adel M.
    Alturki, Fahd A.
    [J]. PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS (HIS 2016), 2017, 552 : 380 - 390
  • [3] A novel hybrid model of augmented grey wolf optimizer and artificial neural network for predicting shear strength of soil
    Rabbani, Ahsan
    Samui, Pijush
    Kumari, Sunita
    [J]. MODELING EARTH SYSTEMS AND ENVIRONMENT, 2023, 9 (02) : 2327 - 2347
  • [4] A novel hybrid model of augmented grey wolf optimizer and artificial neural network for predicting shear strength of soil
    Ahsan Rabbani
    Pijush Samui
    Sunita Kumari
    [J]. Modeling Earth Systems and Environment, 2023, 9 : 2327 - 2347
  • [5] Improved Discrete Grey Wolf Optimizer
    Martin, Benoit
    Marot, Julien
    Bourennane, Salah
    [J]. 2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 494 - 498
  • [6] Improved Grey Wolf Optimizer and Their Applications
    Liang, Xu
    Wang, Di
    Huang, Ming
    [J]. PROCEEDINGS OF 2019 IEEE 7TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2019), 2019, : 107 - 110
  • [7] Improved dynamic grey wolf optimizer
    Zhang, Xiaoqing
    Zhang, Yuye
    Ming, Zhengfeng
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (06) : 877 - 890
  • [8] Design of Multilayer Wideband Microwave Absorbers using Improved Grey Wolf Optimizer
    Zhang, Hao Nan
    Zhang, Zhi Fei
    Du, Yi
    Kong, Wei Bin
    Yang, Xiao Fang
    Fang, Zhong Qing
    [J]. APPLIED COMPUTATIONAL ELECTROMAGNETICS SOCIETY JOURNAL, 2023, 38 (09): : 725 - 733
  • [9] HybGBS: A hybrid neural network and grey wolf optimizer for intrusion detection in a cloud computing environment
    Sumathi, S.
    Rajesh, R.
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024,
  • [10] Forecasting of Daily Total Horizontal Solar Radiation Using Grey Wolf Optimizer and Multilayer Perceptron Algorithms
    Colak, Medine
    Yesibudak, Mehmet
    Bayindir, Ramazan
    [J]. 2019 8TH INTERNATIONAL CONFERENCE ON RENEWABLE ENERGY RESEARCH AND APPLICATIONS (ICRERA 2019), 2019, : 939 - 942