Improved SARSA and DQN algorithms for reinforcement learning

被引:0
|
作者
Yao, Guangyu [1 ,2 ]
Zhang, Nan [1 ,2 ]
Duan, Zhenhua [1 ,2 ]
Tian, Cong [1 ,2 ]
机构
[1] Xidian Univ, Inst Comp Theory & Technol, Xian 710071, Peoples R China
[2] Xidian Univ, ISN Lab, Xian 710071, Peoples R China
关键词
Machine learning; Reinforcement learning; Deep Q-network; epsilon-greedy policy; Value iteration;
D O I
10.1016/j.tcs.2024.115025
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Reinforcement learning is a branch of machine learning in which an agent interacts with an environment to learn optimal actions that maximize cumulative rewards. This paper aims to enhance the SARSA and DQN algorithms in four key aspects: the epsilon-greedy policy, reward function, value iteration approach, and sampling probability. The experiments are conducted in three scenarios: path planning, CartPole, and MountainCar. The results show that, in these environments, the improved algorithms exhibit better convergence, higher rewards, and more stable training processes.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Enhancing Reinforcement Learning Performance in Delayed Reward System Using DQN and Heuristics
    Kim, Keecheon
    IEEE ACCESS, 2022, 10 : 50641 - 50650
  • [42] Convergence of reinforcement learning algorithms and acceleration of learning
    Potapov, A
    Ali, MK
    PHYSICAL REVIEW E, 2003, 67 (02):
  • [43] DQN Reinforcement Learning-based Steering Control Strategy for Autonomous Driving
    Lin, Xinyou
    Ye, Zhuoming
    Zhou, Binhao
    Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2023, 59 (16): : 315 - 324
  • [44] Deep Reinforcement Learning in VizDoom via DQN and Actor-Critic Agents
    Bakhanova, Maria
    Makarov, Ilya
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2021, PT I, 2021, 12861 : 138 - 150
  • [45] Optimizing deep reinforcement learning in data-scarce domains: a cross-domain evaluation of double DQN and dueling DQN
    Din, Nusrat Mohi Ud
    Assad, Assif
    Ul Sabha, Saqib
    Rasool, Muzafar
    INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2024,
  • [46] Improved reinforcement learning with curriculum
    West, Joseph
    Maire, Frederic
    Browne, Cameron
    Denman, Simon
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 158
  • [47] Path Planning via an Improved DQN-Based Learning Policy
    Lv, Liangheng
    Zhang, Sunjie
    Ding, Derui
    Wang, Yongxiong
    IEEE ACCESS, 2019, 7 : 67319 - 67330
  • [48] A survey on Evolutionary Reinforcement Learning algorithms
    Zhu, Qingling
    Wu, Xiaoqiang
    Lin, Qiuzhen
    Ma, Lijia
    Li, Jianqiang
    Ming, Zhong
    Chen, Jianyong
    NEUROCOMPUTING, 2023, 556
  • [49] Aggregation of multiple reinforcement learning algorithms
    Jiang, Ju
    Kamel, Mohamed S.
    Chen, Lei
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2006, 15 (05) : 855 - 861
  • [50] Towards possibilistic reinforcement learning algorithms
    Sabbadin, R
    10TH IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-3: MEETING THE GRAND CHALLENGE: MACHINES THAT SERVE PEOPLE, 2001, : 404 - 407