Computational Missile Guidance: A Deep Reinforcement Learning Approach

被引:0
|
作者
He, Shaoming [1 ]
Shin, Hyo-Sang [2 ]
Tsourdos, Antonios [2 ]
机构
[1] Beijing Inst Technol, Sch Aerosp Engn, 5 South Zhongguancun Rd, Beijing 100081, Peoples R China
[2] Cranfield Univ, Sch Aerosp Transport & Mfg, Coll Rd, Cranfield MK43 0AL, Beds, England
来源
关键词
BIASED PNG LAW; IMPACT;
D O I
10.2514/1.I010970
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper aims to examine the potential of using the emerging deep reinforcement learning techniques in missile guidance applications. To this end, a Markovian decision process that enables the application of reinforcement learning theory to solve the guidance problem is formulated. A heuristic way is used to shape a proper reward function that has tradeoff between guidance accuracy, energy consumption, and interception time. The state-of-the-art deep deterministic policy gradient algorithm is used to learn an action policy that maps the observed engagements states to a guidance command. Extensive empirical numerical simulations are performed to validate the proposed computational guidance algorithm.
引用
收藏
页码:571 / 582
页数:12
相关论文
共 50 条
  • [1] Deep reinforcement learning-based robust missile guidance
    Ahn, Jeongsu
    Shin, Jongho
    Kim, Hyeong-Geun
    [J]. 2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 927 - 930
  • [2] Integrated Guidance and Control for Missile Using Deep Reinforcement Learning
    Pei, Pei
    He, Shao-Ming
    Wang, Jiang
    Lin, De-Fu
    [J]. Yuhang Xuebao/Journal of Astronautics, 2021, 42 (10): : 1293 - 1304
  • [3] Missile guidance with assisted deep reinforcement learning for head-on interception of maneuvering target
    Weifan Li
    Yuanheng Zhu
    Dongbin Zhao
    [J]. Complex & Intelligent Systems, 2022, 8 : 1205 - 1216
  • [4] Deep reinforcement learning based missile guidance law design for maneuvering target interception
    Du, Mingjian
    Peng, Chi
    Ma, Jianjun
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 3733 - 3738
  • [5] Missile guidance with assisted deep reinforcement learning for head-on interception of maneuvering target
    Li, Weifan
    Zhu, Yuanheng
    Zhao, Dongbin
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (02) : 1205 - 1216
  • [6] A hierarchical reinforcement learning method for missile evasion and guidance
    Yan, Mengda
    Yang, Rennong
    Zhang, Ying
    Yue, Longfei
    Hu, Dongyuan
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [7] A hierarchical reinforcement learning method for missile evasion and guidance
    Mengda Yan
    Rennong Yang
    Ying Zhang
    Longfei Yue
    Dongyuan Hu
    [J]. Scientific Reports, 12
  • [8] Deep Learning Midcourse Guidance for Interceptor Missile
    Huang, Liming
    Chen, Wanchun
    [J]. PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 1129 - 1134
  • [9] A deep reinforcement learning approach incorporating genetic algorithm for missile path planning
    Xu, Shuangfei
    Bi, Wenhao
    Zhang, An
    Wang, Yunong
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (05) : 1795 - 1814
  • [10] A deep reinforcement learning approach incorporating genetic algorithm for missile path planning
    Shuangfei Xu
    Wenhao Bi
    An Zhang
    Yunong Wang
    [J]. International Journal of Machine Learning and Cybernetics, 2024, 15 : 1795 - 1814