Dynamic multi-strategy integrated differential evolution algorithm based on reinforcement learning for optimization problems

被引:0
|
作者
Yang, Qingyong [1 ]
Chu, Shu-Chuan [1 ]
Pan, Jeng-Shyang [1 ,2 ]
Chou, Jyh-Horng [3 ,4 ]
Watada, Junzo [5 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[2] Chaoyang Univ Technol, Dept Informat Management, Taichung, Taiwan
[3] Kaohsiung Med Univ, Dept Healthcare Adm & Med Informat, Kaohsiung 807, Taiwan
[4] Feng Chia Univ, Dept Mech & Comp Aided Engn, Taichung 407, Taiwan
[5] Waseda Univ, Grad Sch Informat Prod & Syst, Kitakyushu 8080135, Japan
关键词
Differential evolution; Multi-population; Population diversity; Reinforcement learning; Individual dynamic migration; MUTATION STRATEGY; ENSEMBLE; SEARCH; PARAMETERS; SOLVE;
D O I
10.1007/s40747-023-01243-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The introduction of a multi-population structure in differential evolution (DE) algorithm has been proven to be an effective way to achieve algorithm adaptation and multi-strategy integration. However, in existing studies, the mutation strategy selection of each subpopulation during execution is fixed, resulting in poor self-adaptation of subpopulations. To solve this problem, a dynamic multi-strategy integrated differential evolution algorithm based on reinforcement learning (RLDMDE) is proposed in this paper. By employing reinforcement learning, each subpopulation can adaptively select the mutation strategy according to the current environmental state (population diversity). Based on the population state, this paper proposes an individual dynamic migration strategy to "reward" or "punish" the population to avoid wasting individual computing resources. Furthermore, this paper applies two methods of good point set and random opposition-based learning (ROBL) in the population initialization stage to improve the quality of the initial solutions. Finally, to evaluate the performance of the RLDMDE algorithm, this paper selects two benchmark function sets, CEC2013 and CEC2017, and six engineering design problems for testing. The results demonstrate that the RLDMDE algorithm has good performance and strong competitiveness in solving optimization problems.
引用
收藏
页码:1845 / 1877
页数:33
相关论文
共 50 条
  • [1] Dynamic multi-strategy integrated differential evolution algorithm based on reinforcement learning for optimization problems
    Qingyong Yang
    Shu-Chuan Chu
    Jeng-Shyang Pan
    Jyh-Horng Chou
    Junzo Watada
    [J]. Complex & Intelligent Systems, 2024, 10 : 1845 - 1877
  • [2] Prediction based Multi-strategy Differential Evolution Algorithm for Dynamic Environments
    Wan, Shuzhen
    Xiong, Shengwu
    Liu, Yi
    [J]. 2012 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2012,
  • [3] Multi-strategy multi-objective differential evolutionary algorithm with reinforcement learning
    Han, Yupeng
    Peng, Hu
    Mei, Changrong
    Cao, Lianglin
    Deng, Changshou
    Wang, Hui
    Wu, Zhijian
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 277
  • [4] Multi-strategy self-learning particle swarm optimization algorithm based on reinforcement learning
    Meng, Xiaoding
    Li, Hecheng
    Chen, Anshan
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 8498 - 8530
  • [5] Multi-Strategy Dynamic Fruit Fly Optimization Algorithm for Continuous Optimization Problems
    Shi, Jian-Ping
    Li, Pei-Shen
    Liu, Guo-Pin
    Liu, Peng
    [J]. Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2020, 49 (05): : 718 - 731
  • [6] Reinforcement learning-based differential evolution algorithm for constrained multi-objective optimization problems
    Yu, Xiaobing
    Xu, Pingping
    Wang, Feng
    Wang, Xuming
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [7] Differential evolution based on strategy adaptation and deep reinforcement learning for multimodal optimization problems
    Liao, Zuowen
    Pang, Qishuo
    Gu, Qiong
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2024, 87
  • [8] Multi-strategy Differential Evolution
    Yaman, Anil
    Iacca, Giovanni
    Coler, Matt
    Fletcher, George
    Pechenizkiy, Mykola
    [J]. APPLICATIONS OF EVOLUTIONARY COMPUTATION, EVOAPPLICATIONS 2018, 2018, 10784 : 617 - 633
  • [9] A multi-strategy particle swarm optimization framework based on deep reinforcement learning
    Hou, Leyong
    Fan, Debin
    Cheng, Junjie
    Wu, Honglian
    Peng, Hu
    Deng, Changshou
    [J]. 2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI, 2023,
  • [10] A Hybrid Algorithm Based on Multi-Strategy Elite Learning for Global Optimization
    Zhao, Xuhua
    Yang, Chao
    Zhu, Donglin
    Liu, Yujia
    [J]. ELECTRONICS, 2024, 13 (14)