Evolving population method for real-time reinforcement learning

被引:4
|
作者
Kim, Man-Je [1 ]
Kim, Jun Suk [2 ]
Ahn, Chang Wook [1 ]
机构
[1] Gwangju Inst Sci & Technol GIST, AI Grad Sch, Gwangju, South Korea
[2] Gwangju Inst Sci & Technol GIST, Sch Elect Engn & Comp Sci, 123 Cheomdangwagi Ro, Gwangju 61005, South Korea
基金
新加坡国家研究基金会;
关键词
Reinforcement learning; Deep Q network; Monte Carlo tree search; Real-time reinforcement learning; Genetic algorithm; GENETIC ALGORITHM; LEVEL; GO;
D O I
10.1016/j.eswa.2023.120493
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reinforcement learning has recently been recognized as a promising means of machine learning, but its applica-bility remains limited in real-time environment due to its short response time, high computational complexity, and instability in learning. Although researchers devised several measures in attempts to press beyond the horizon, the problems consisting of large branching factors with real-time properties still stays unconquered, demanding a new method for reinforcement learning as a whole. In this paper, we propose Evolving Population. This method improves the performance of reinforcement learning by optimizing hyperparameters and available actions. This method uses an iterative structure based on an evolutionary strategy to optimize these elements. We validate the performance of our method in an environment with real-time properties and large branching factors.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Real-Time Reinforcement Learning
    Ramstedt, Simon
    Pal, Christopher
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [2] Applying Reinforcement Learning Method for Real-time Energy Management
    Dayani, Aida Borhan
    Fazlollahtabar, Hamed
    Ahmadiahangar, Roya
    Rosin, Argo
    Naderi, Mohammad Salay
    Bagheri, Mehdi
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2019 IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC / I&CPS EUROPE), 2019,
  • [3] Benchmarking Real-Time Reinforcement Learning
    Thodoroff, Pierre
    Li, Wenyu
    Lawrence, Neil D.
    [J]. NEURIPS 2021 WORKSHOP ON PRE-REGISTRATION IN MACHINE LEARNING, VOL 181, 2021, 181 : 26 - 41
  • [4] English synchronous real-time translation method based on reinforcement learning
    Ke, Xin
    [J]. WIRELESS NETWORKS, 2024, 30 (05) : 4167 - 4179
  • [5] Reinforcement Learning Method for Ad Networks Ordering in Real-Time Bidding
    Afshar, Reza Refaei
    Zhang, Yingqian
    Firat, Murat
    Kaymak, Uzay
    [J]. AGENTS AND ARTIFICIAL INTELLIGENCE, ICAART 2019, 2019, 11978 : 16 - 36
  • [7] Real-Time IDS Using Reinforcement Learning
    Sagha, Hesam
    Shouraki, Saeed Bagheri
    Khasteh, Hosein
    Dehghani, Mahdi
    [J]. 2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL II, PROCEEDINGS, 2008, : 593 - +
  • [8] Reinforcement learning in real-time geometry assurance
    Jorge, Emilio
    Brynte, Lucas
    Cronrath, Constantin
    Wigstrom, Oskar
    Bengtsson, Kristofer
    Gustaysson, Emil
    Lennartson, Bengt
    Jirstrand, Mats
    [J]. 51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 : 1073 - 1078
  • [9] Real-time optimization using reinforcement learning
    Powell, By Kody M.
    Machalek, Derek
    Quah, Titus
    [J]. COMPUTERS & CHEMICAL ENGINEERING, 2020, 143 (143)
  • [10] Reinforcement Learning method with Dynamic Learning Rate for Real-Time Route Guidance based on SUMO
    Li, Yuzhen
    Tang, Jiawen
    Zhao, Han
    Luo, Ruikang
    [J]. 2022 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2022, : 820 - 824