Competing leaders grey wolf optimizer and its application for training multi-layer perceptron classifier

被引:1
|
作者
Yang, Zhenlun [1 ]
机构
[1] Guangzhou Panyu Polytech, Sch Informat Engn, Guangzhou 511483, Guangdong, Peoples R China
关键词
Multi-layer perceptron; Grey wolf optimizer; Competing leaders; Neural networks; Swarm intelligence algorithm; ALGORITHM;
D O I
10.1016/j.eswa.2023.122349
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The multi-layer perceptron (MLP) is a highly popular artificial neural network used for classification across various applications. Swarm intelligence algorithms, such as the grey wolf optimizer, battle royale optimizer, sine cosine algorithm, and their improved variants, have been widely utilized for training MLP classifiers, addressing the challenging optimization problem that covers various difficulties in determining the optimal network parameters to minimize errors while processing datasets. Nevertheless, these prevailing algorithms frequently encounter problems like stagnation in local optima and inefficient search, leading to a deficiency in their ability to deliver efficient and accurate solutions. In order to overcome this challenge and provide a powerful tool for MLP classifier training, the competing leaders grey wolf optimizer (CGWO) is proposed in this study. CGWO benefits from a novel mechanism of competing leaders that provides a flexible wolf pack leadership hierarchy to avoid stagnation in local optima and accelerate convergence speed. In addition, a population diversity-enhanced initiation method is designed to help improve the efficiency of the mechanism of competing leaders. The performance of CGWO in training MLP classifiers is evaluated in an experiment comparing CGWO with nine state-of-the-art algorithms on eleven classification datasets representing a wide range of optimization challenges. CGWO substantially outperforms its competitors regarding optimal fitness, classification accuracy, and convergence speed; and shows competitive performance in computation time comparison.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Application of multi-layer perceptron neural networks to vision problems
    Khotanzad, A
    Chung, C
    NEURAL COMPUTING & APPLICATIONS, 1998, 7 (03): : 249 - 259
  • [32] Application of a Multi-Layer Perceptron in Preoperative Screening for Orthognathic Surgery
    Chaiprasittikul, Natkritta
    Thanathornwong, Bhornsawan
    Pornprasertsuk-Damrongsri, Suchaya
    Raocharernporn, Somchart
    Maponthong, Somporn
    Manopatanakul, Somchai
    HEALTHCARE INFORMATICS RESEARCH, 2023, 29 (01) : 16 - 22
  • [33] Application Aware Tuning of Reconfigurable Multi-Layer Perceptron Architectures
    Sanaullah, Ahmed
    Yang, Chen
    Alexeev, Yuri
    Yoshii, Kazutomo
    Herbordt, Martin C.
    2018 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2018,
  • [34] Application of multi-layer perceptron neural networks to vision problems
    A. Khotanzad
    C. Chung
    Neural Computing & Applications, 1998, 7 : 249 - 259
  • [35] Multi-layer weighted grey principal component evaluation model and its application
    Wang L.-L.
    Fang Z.-G.
    Kongzhi yu Juece/Control and Decision, 2019, 34 (06): : 1300 - 1306
  • [36] Hybrid wolf-bat algorithm for optimization of connection weights in multi-layer perceptron
    Agrawal, Utkarsh
    Arora, Jatin
    Singh, Rahul
    Gupta, Deepak
    Khanna, Ashish
    Khamparia, Aditya
    Gupta, Deepak (deepakgupta@mait.ac.in), 1600, Association for Computing Machinery, 2 Penn Plaza, Suite 701, New York, NY 10121-0701, United States (16):
  • [37] Multi-Layer Perceptron Training Optimization Using Nature Inspired Computing
    Al Bataineh, Ali
    Kaur, Devinder
    Jalali, Seyed Mohammad J.
    IEEE ACCESS, 2022, 10 : 36963 - 36977
  • [38] Hybrid Particle Swarm and Grey Wolf Optimizer and its application to clustering optimization
    Zhang, Xinming
    Lin, Qiuying
    Mao, Wentao
    Liu, Shangwang
    Dou, Zhi
    Liu, Guoqi
    APPLIED SOFT COMPUTING, 2021, 101
  • [39] Multi-layer perceptron training algorithms for pattern recognition of myoelectric signals
    Khong, Le M. D.
    Gale, Timothy J.
    Jiang, Danchi
    Olivier, Jan C.
    Ortiz-Catalan, Max
    6TH BIOMEDICAL ENGINEERING INTERNATIONAL CONFERENCE (BMEICON 2013), 2013,
  • [40] Training Multi-Layer Perceptron with Enhanced Brain Storm Optimization Metaheuristics
    Bacanin, Nebojsa
    Alhazmi, Khaled
    Zivkovic, Miodrag
    Venkatachalam, K.
    Bezdan, Timea
    Nebhen, Jamel
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (02): : 4199 - 4215