A survey on Evolutionary Reinforcement Learning algorithms

被引:11
|
作者
Zhu, Qingling [1 ]
Wu, Xiaoqiang [1 ]
Lin, Qiuzhen [1 ]
Ma, Lijia [1 ]
Li, Jianqiang [1 ]
Ming, Zhong [1 ]
Chen, Jianyong [1 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Evolutionary algorithm; Reinforcement learning; Evolutionary reinforcement learning; Policy optimization; NEURAL-NETWORKS; OPTIMIZATION;
D O I
10.1016/j.neucom.2023.126628
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reinforcement Learning (RL) has proven to be highly effective in various real-world applications. However, in certain scenarios, Evolutionary Algorithms (EAs) have been utilized as an alternative to RL algorithms. Recently, Evolutionary Reinforcement Learning algorithms (ERLs) have emerged as a promising solution that combines the advantages of both RL and EA. This paper presents a comprehensive survey that encompasses a majority of the studies in this exciting research area. We classify these ERLs according to the EA used in their frameworks and analyze the strengths and limitations of various EA components and combination schemes. Additionally, we conduct several experiments to evaluate the performance of some representative ERLs. By categorizing the different approaches and assessing their effectiveness, the paper can assist researchers and practitioners in selecting the most suitable method for their particular application.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Survey of Deep Reinforcement Learning Methods with Evolutionary Algorithms
    Lü, Shuai
    Gong, Xiao-Yu
    Zhang, Zheng-Hao
    Han, Shuai
    Zhang, Jun-Wei
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (07): : 1478 - 1499
  • [2] Reinforcement learning versus evolutionary computation: A survey on hybrid algorithms
    Drugan, Madalina M.
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2019, 44 : 228 - 246
  • [3] Evolutionary algorithms for reinforcement learning
    Moriarty, DE
    Schultz, AC
    Grefenstette, JJ
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 1999, 11 : 241 - 276
  • [4] Evolutionary Reinforcement Learning: A Survey
    Bai, Hui
    Cheng, Ran
    Jin, Yaochu
    [J]. Intelligent Computing, 2023, 2
  • [5] Reinforcement learning algorithms: A brief survey
    Shakya, Ashish Kumar
    Pillai, Gopinatha
    Chakrabarty, Sohom
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [6] Reinforcement learning for online control of evolutionary algorithms
    Eiben, A. E.
    Horvath, Mark
    Kowalczyk, Wojtek
    Schut, Martijn C.
    [J]. ENGINEERING SELF-ORGANISING SYSTEMS, 2007, 4335 : 151 - +
  • [7] Evolutionary Algorithms and Reinforcement Learning in Experiments with Slot Cars
    Martinec, Dan
    Bundzel, Marek
    [J]. 2013 INTERNATIONAL CONFERENCE ON PROCESS CONTROL (PC), 2013, : 159 - 162
  • [8] Universal Reinforcement Learning Algorithms: Survey and Experiments
    Aslanides, John
    Leike, Jan
    Hutter, Marcus
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1403 - 1410
  • [9] Research on Spiking Reinforcement Learning Algorithms: A Survey
    Chen, Ding
    Huang, Yang-Ru
    Peng, Pei-Xi
    Huang, Tie-Jun
    Tian, Yong-Hong
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2023, 46 (10): : 2132 - 2160
  • [10] A survey of evolutionary algorithms for supervised ensemble learning
    Cagnini, Henry E. L.
    Das Dores, Silvia C. N.
    Freitas, Alex A.
    Barros, Rodrigo C.
    [J]. KNOWLEDGE ENGINEERING REVIEW, 2023, 38 (05):