Let a biogeography-based optimizer train your Multi-Layer Perceptron

被引:240
|
作者
Mirjalili, Seyedali [1 ]
Mirjalili, Seyed Mohammad [2 ]
Lewis, Andrew [1 ]
机构
[1] Griffith Univ, Sch Informat & Commun Technol, Brisbane, Qld 4111, Australia
[2] ZPS Co, Tehran, Iran
关键词
FNN; Neural network; Learning neural network; Biogeography-Based Optimization; BBO; Evolutionary algorithm; PARTICLE SWARM OPTIMIZATION; ARTIFICIAL NEURAL-NETWORKS; EXTREME LEARNING-MACHINE; KRILL HERD ALGORITHM; CONVERGENCE; RATES; SELECTION;
D O I
10.1016/j.ins.2014.01.038
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Multi-Lager Perceptron (MLP), as one of the most-widely used Neural Networks (NNs), has been applied to many practical problems. The MLP requires training on specific applications, often experiencing problems of entrapment in local minima, convergence speed, and sensitivity to initialization. This paper proposes the use of the recently developed Biogeography-Based Optimization (BBO) algorithm for training MLPs to reduce these problems. In order to investigate the efficiencies of BBO in training MLPs, five classification datasets, as well as six function approximation datasets are employed. The results are compared to five well-known heuristic algorithms, Back Propagation (BP), and Extreme Learning Machine (ELM) in terms of entrapment in local minima, result accuracy, and convergence rate. The results show that training MLPs by using BBO is significantly better than the current heuristic learning algorithms and BP. Moreover, the results show that BBO is able to provide very competitive results in comparison with ELM. (C) 2014 Elsevier Inc. All rights reserved.
引用
收藏
页码:188 / 209
页数:22
相关论文
共 50 条
  • [1] Multi-layer perceptron classification method of medical data based on biogeography-based optimization algorithm with probability distributions
    Li, Xu-Dong
    Wang, Jie-Sheng
    Hao, Wen-Kuo
    Wang, Min
    Zhang, Min
    [J]. APPLIED SOFT COMPUTING, 2022, 121
  • [2] Battle royale optimizer for training multi-layer perceptron
    Agahian, Saeid
    Akan, Taymaz
    [J]. EVOLVING SYSTEMS, 2022, 13 (04) : 563 - 575
  • [3] Battle royale optimizer for training multi-layer perceptron
    Saeid Agahian
    Taymaz Akan
    [J]. Evolving Systems, 2022, 13 : 563 - 575
  • [4] A novel artificial intelligence approach based on Multi-layer Perceptron Neural Network and Biogeography-based Optimization for predicting coefficient of consolidation of soil
    Binh Thai Pham
    Manh Duc Nguyen
    Kien-Trinh Thi Bui
    Prakash, Indra
    Chapi, Kamran
    Dieu Tien Bui
    [J]. CATENA, 2019, 173 : 302 - 311
  • [5] Using Fitness Dependent Optimizer for Training Multi-layer Perceptron
    Abbas, Dosti Kh
    Rashid, Tarik A.
    Abdalla, Karmand H.
    Bacanin, Nebojsa
    Alsadoon, Abeer
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2021, 22 (07): : 1575 - 1586
  • [6] A cooperative coevolutionary biogeography-based optimizer
    Xiang-wei Zheng
    Dian-jie Lu
    Xiao-guang Wang
    Hong Liu
    [J]. Applied Intelligence, 2015, 43 : 95 - 111
  • [7] Design and implementation of a neighborhood search biogeography-based optimization trainer for classifying sonar dataset using multi-layer perceptron neural network
    Kaveh, M.
    Khishe, M.
    Mosavi, M. R.
    [J]. ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2019, 100 (02) : 405 - 428
  • [8] Design and implementation of a neighborhood search biogeography-based optimization trainer for classifying sonar dataset using multi-layer perceptron neural network
    M. Kaveh
    M. Khishe
    M. R. Mosavi
    [J]. Analog Integrated Circuits and Signal Processing, 2019, 100 : 405 - 428
  • [9] A cooperative coevolutionary biogeography-based optimizer
    Zheng, Xiang-wei
    Lu, Dian-jie
    Wang, Xiao-guang
    Liu, Hong
    [J]. APPLIED INTELLIGENCE, 2015, 43 (01) : 95 - 111
  • [10] An immune and a gradient-based method to train multi-layer perceptron neural networks
    Pasti, Rodrigo
    de Castro, Leandro Nunes
    [J]. 2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, : 2075 - +