A multi-agent optimization algorithm and its application to training multilayer perceptron models

被引:5
|
作者
Chauhan, Dikshit [1 ]
Yadav, Anupam [1 ]
Neri, Ferrante [2 ]
机构
[1] Dr BR Ambedkar Natl Inst Technol Jalandhar, Dept Math, Jalandhar 144008, India
[2] Univ Surrey, Dept Comp Sci, NICE Res Grp, Guildford, England
关键词
Meta-heuristic algorithms; Optimization; Artificial intelligence; Neural network; PARTICLE SWARM OPTIMIZATION; ARTIFICIAL NEURAL-NETWORKS; DIFFERENTIAL EVOLUTION; GLOBAL OPTIMIZATION; HYBRID MODEL; BACKPROPAGATION; PSO; CLASSIFICATION; PREDICTION; PARAMETERS;
D O I
10.1007/s12530-023-09518-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The optimal parameter values in a feed-forward neural network model play an important role in determining the efficiency and significance of the trained model. In this paper, we propose an upgraded artificial electric field algorithm (AEFA) for training feed-forward neural network models. This paper also throws some light on the effective use of multi-agent meta-heuristic techniques for the training of neural network models and their future prospects. Seven real-life data sets are used to train neural network models, the results of these trained models show that the proposed scheme performs well in comparison to other training algorithms in terms of high classification accuracy and minimum test error values including gradient-based algorithms and differential evolution variants. Some fundamental modifications in AEFA are also proposed to make it more suitable for training neural networks. All the experimental findings show that the search capabilities and convergence rate of the proposed scheme are better than those of other capable schemes, including gradient-based schemes.
引用
收藏
页码:849 / 879
页数:31
相关论文
共 50 条
  • [1] The application of multi-agent optimization algorithm to automatically calibrate simulation models
    Letkowski, Piotr
    [J]. NAFTA-GAZ, 2016, 72 (09): : 704 - 712
  • [2] Multilayer Perceptron: Architecture Optimization and Training
    Ramchoun, Hassan
    Amine, Mohammed
    Idrissi, Janati
    Ghanou, Youssef
    Ettaouil, Mohamed
    [J]. INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2016, 4 (01): : 26 - 30
  • [3] A hybrid crossover multi-agent multi-objective evolutionary algorithm and its application in microgrid operation optimization
    Liu, Liheng
    Zhang, Dongliang
    Wang, Jinping
    Yan, Jin
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2022, 22 (05) : 1663 - 1679
  • [4] Hybrid Nelder–Mead Algorithm and Dragonfly Algorithm for Function Optimization and the Training of a Multilayer Perceptron
    Jianzhong Xu
    Fu Yan
    [J]. Arabian Journal for Science and Engineering, 2019, 44 : 3473 - 3487
  • [5] Multi-agent Order Selection and Its Optimization Method with Evolution Algorithm
    Zhang, Li
    Zhang, Jiewu
    Ma, Weijun
    [J]. INFORMATION TECHNOLOGY FOR MANUFACTURING SYSTEMS, PTS 1 AND 2, 2010, : 1066 - +
  • [6] An Algorithm for Multi-Objective Multi-Agent Optimization
    Blondin, Maude J.
    Hale, Matthew
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 1489 - 1494
  • [7] A hybrid multi-agent Coordination Optimization Algorithm
    Zhang, Haopeng
    Su, Siheng
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2019, 51
  • [8] Multilayer perceptron training using an evolutionary algorithm
    El Hamdi, Ridha
    Njah, Mohamed
    Chtourou, Mohamed
    [J]. INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2008, 5 (04) : 305 - 312
  • [9] Research on WLAN Planning Problem Based on Optimization Models and Multi-Agent Algorithm
    Zheng, You
    Shi, Tailong
    Xu, Xiaohuo
    Yuan, Hongxing
    Yao, Tuozhong
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS (CIS) AND IEEE CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS (RAM), 2017, : 249 - 254
  • [10] Multi-Resolution Dijkstra Method Based on Multi-Agent Simulation and its Application to Genetic Algorithm for Classroom Optimization
    Maekawa, Kotaro
    Sawase, Kazuhito
    Nobuhara, Hajime
    [J]. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2014, 18 (02) : 113 - 120