A Deep Reinforcement Learning Approach for the Pursuit Evasion Game in the Presence of Obstacles

被引:0
|
作者
Qi, Qi [1 ]
Zhang, Xuebo [1 ]
Guo, Xian [1 ]
机构
[1] Nankai Univ, Inst Robot & Automat Informat Syst IRAIS, Tianjin Key Lab Intelligent Robot TJKLIR, Tianjin 300071, Peoples R China
关键词
LEVEL; GO;
D O I
10.1109/rcar49640.2020.9303044
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In a pursuit-evasion game, the pursuer tries to capture the evader, while the evader actively avoids being captured. Traditional approaches usually ignore or simplify kinematic constraints by using a grip world discrete model and they assume that the game is played in free space without obstacles. In this paper, a curriculum deep reinforcement learning approach is proposed for the pursuit-evasion game, which considers the kinematics of mobile robot in practical applications and the influence of static obstacles in the environment. To improve the system performance, we use the mechanism of self-play to train the pursuer and the evader at the same time. In addition, the method of curriculum learning is used, making the agent learn simpler tasks before learning more complicated ones. Comparative simulation results show that the proposed approach presents superior performance for both pursuer and evader when playing against intelligent opponents.
引用
收藏
页码:68 / 73
页数:6
相关论文
共 50 条
  • [1] An Application of Continuous Deep Reinforcement Learning Approach to Pursuit-Evasion Differential Game
    Wang, Maolin
    Wang, Lixin
    Yue, Ting
    [J]. PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 1150 - 1155
  • [2] Pursuit and Evasion Strategy of a Differential Game Based on Deep Reinforcement Learning
    Xu, Can
    Zhang, Yin
    Wang, Weigang
    Dong, Ligang
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2022, 10
  • [3] A simplified pursuit-evasion game with reinforcement learning
    Paczolay, Gabor
    Harmati, Istvan
    [J]. Periodica polytechnica Electrical engineering and computer science, 2021, 65 (02): : 160 - 166
  • [4] Intelligent Pursuit-Evasion Game Based on Deep Reinforcement Learning for Hypersonic Vehicles
    Gao, Mengjing
    Yan, Tian
    Li, Quancheng
    Fu, Wenxing
    Zhang, Jin
    [J]. AEROSPACE, 2023, 10 (01)
  • [5] Transfer reinforcement learning for multi-agent pursuit-evasion differential game with obstacles in a continuous environment
    Hu, Penglin
    Pan, Quan
    Zhao, Chunhui
    Guo, Yaning
    [J]. ASIAN JOURNAL OF CONTROL, 2024, 26 (04) : 2125 - 2140
  • [6] Intelligent Maneuver Strategy for a Hypersonic Pursuit-Evasion Game Based on Deep Reinforcement Learning
    Guo, Yunhe
    Jiang, Zijian
    Huang, Hanqiao
    Fan, Hongjia
    Weng, Weiye
    [J]. AEROSPACE, 2023, 10 (09)
  • [7] Game-Theoretic Analysis of a Visibility Based Pursuit-Evasion Game in the Presence of Obstacles
    Bhattacharya, Sourabh
    Hutchinson, Seth
    Basar, Tamer
    [J]. 2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, : 373 - 378
  • [8] Pursuit-evasion games in the presence of obstacles
    Oyler, Dave W.
    Kabamba, Pierre T.
    Girard, Anouck R.
    [J]. AUTOMATICA, 2016, 65 : 1 - 11
  • [9] Game of Drones: Multi-UAV Pursuit-Evasion Game With Online Motion Planning by Deep Reinforcement Learning
    Zhang, Ruilong
    Zong, Qun
    Zhang, Xiuyun
    Dou, Liqian
    Tian, Bailing
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7900 - 7909
  • [10] Game of Marine Robots: USV Pursuit Evasion Game Using Online Reinforcement Learning
    Wang, Yongkang
    Wang, Yong
    Cui, Rongxin
    Guo, Xinxin
    Yan, Weisheng
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, ICDL, 2023, : 121 - 126