Adaptive memetic method of multi-objective genetic evolutionary algorithm for backpropagation neural network

被引:1
|
作者
Ashraf Osman Ibrahim
Siti Mariyam Shamsuddin
Ajith Abraham
Sultan Noman Qasem
机构
[1] Alzaiem Alazhari University,Faculty of Computer Science and Information Technology
[2] Arab Open University,Faculty of computer science
[3] Future University,UTM Big Data Centre
[4] Universiti Teknologi Malaysia,Machine Intelligence Research Labs (MIR Labs)
[5] Scientific Network for Innovation and Research Excellence,Computer Science Department, College of Computer and Information Sciences
[6] Al Imam Mohammad Ibn Saud Islamic University (IMSIU),Computer Science Department, Faculty of Applied Sciences
[7] Taiz University,undefined
来源
关键词
Self-adaptive; Artificial neural networks; Three-term backpropagation; Multi-objective evolutionary; Non-dominated sorting genetic algorithm-II;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, multi-objective evolutionary optimization algorithms have shown success in different areas of research. Due to their efficiency and power, many researchers have concentrated on adapting evolutionary algorithms to generate Pareto solutions. This paper proposes a new memetic adaptive multi-objective evolutionary algorithm that is based on a three-term backpropagation network (MAMOT). This algorithm is an automatic search method for optimizing the parameters and performance of neural networks, and it relies on the use of the adaptive non-dominated sorting genetic algorithm-II integrated with the backpropagation algorithm, being used as a local search method. The presented MAMOT employs a self-adaptive mechanism toward improving the performance of the proposed algorithm and a local optimizer improving all the individuals in a population in order to obtain better accuracy and connection weights. In addition, it selects an appropriate number of hidden nodes simultaneously. The proposed method was applied to 11 datasets representing pattern classification problems, including two-class, multi-class and complex data reflecting real problems. Experiments were performed, and the results indicated that the proposed method is viable in pattern classification tasks compared to a multi-objective genetic algorithm based on a three-term backpropagation network (MOGAT) and some of the methods mentioned in the literature. The statistical analysis results of the t test and Wilcoxon signed-ranks test also show that the performance of the proposed method is significantly better than MOGAT.
引用
收藏
页码:4945 / 4962
页数:17
相关论文
共 50 条
  • [21] A multi-objective memetic algorithm with adaptive local search for airspace complexity mitigation
    Li, Biyue
    Guo, Tong
    Mei, Yi
    Li, Yumeng
    Chen, Jun
    Zhang, Yu
    Tang, Ke
    Du, Wenbo
    SWARM AND EVOLUTIONARY COMPUTATION, 2023, 83
  • [22] An Improved Multi-objective Evolutionary Memetic Algorithm based on Multi-population and Its Application
    Xiao Zhongliang
    FOURTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2012), 2012, 8334
  • [23] Multi-Objective Hierarchical Genetic Algorithm for Modular Granular Neural Network Optimization
    Sanchez, Daniela
    Melin, Patricia
    SOFT COMPUTING APPLICATIONS IN OPTIMIZATION, CONTROL, AND RECOGNITION, 2013, 294 : 157 - 185
  • [24] RBF neural network design based on multi-objective hierarchical genetic algorithm
    Qin, Yong
    Zhang, Yuan
    Xing, Zong-Yi
    Hou, Yuan-Long
    Jia, Li-Min
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2009, 40 (SUPPL. 1): : 35 - 41
  • [25] A Memetic Evolutionary Multi-Objective Optimization Method for Environmental Power Unit Commitment
    Li, Yan-Fu
    Pedroni, Nicola
    Zio, Enrico
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2013, 28 (03) : 2660 - 2669
  • [26] MULTI-OBJECTIVE OPTIMIZATION IN RELIABILITY SYSTEM USING GENETIC ALGORITHM AND NEURAL NETWORK
    Chen, Liang-Hsuan
    Chiang, Cheng-Hsiung
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2008, 25 (05) : 649 - 672
  • [27] GenExp: Multi-objective pruning for deep neural network based on genetic algorithm
    Xu, Ke
    Zhang, Dezheng
    An, Jianjing
    Liu, Li
    Liu, Lingzhi
    Wang, Dong
    NEUROCOMPUTING, 2021, 451 : 81 - 94
  • [28] A hybrid adaptive multi-objective memetic algorithm for 0/1 knapsack problem
    Guo, XP
    Wu, ZM
    Yang, GK
    AI 2005: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2005, 3809 : 176 - 185
  • [29] ESTIMATION OF PREDICTION INTERVALS OF NEURAL NETWORK MODELS BY A MULTI-OBJECTIVE GENETIC ALGORITHM
    Ronay, A. K.
    Li, Yanfu
    Zio, Enrico
    UNCERTAINTY MODELING IN KNOWLEDGE ENGINEERING AND DECISION MAKING, 2012, 7 : 1036 - 1041
  • [30] An adaptive disturbance multi-objective evolutionary algorithm based on decomposition
    Shi, Yanfang
    Shi, Jianguo
    INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2022, 41 (04) : 306 - 315