Intelligent Maneuver Decision Method of UAV based on Reinforcement Learning and Neural Network

被引:0
|
作者
Thou, Huan [1 ]
Zhang, Senyu [1 ]
Sun, Chu [1 ]
Ru, Changjian [2 ]
机构
[1] Air Force Engn Univ, Aeronaut Engn Coll, Xian 710038, Peoples R China
[2] PLA, Unit 94019, Hetian 848000, Peoples R China
关键词
UAV; Intelligent Decision; Reinforcement Learning; Neural Network and Autonomous Air Combat; AIR COMBAT;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The efficiency of UAV maneuver decision-making based on the traditional maneuver control quantity is the key to restrict the improvement of UAV autonomous air combat game ability in complex battlefield environment. By refining pilots' combat training and air combat thinking experience, the intelligent maneuver decision-making method for UAV autonomous air combat can effectively improve the UAV autonomous air combat efficiency. Aiming at the problem of maneuver decision-making in continuous state space, this paper designs an autonomous maneuver decision-making model based on actor critical reinforcement learning theory, adopts NRBF neural network as the value function approximator, the action controller outputs continuous control variables, and introduces Gaussian random action variables to balance the problem of "exploration utilization" in strategy learning A state space adaptive adjustment method based on relative entropy distance is proposed to simplify the network structure and enhance the learning ability of the network. The simulation results show that the proposed method has the ability of air combat confrontation, the output control quantity is smooth, and the strategy learning efficiency is higher.
引用
收藏
页码:8544 / 8549
页数:6
相关论文
共 50 条
  • [1] An Intelligent Tracking Method of Rotor UAV Based on Reinforcement Learning
    Shi, Hao-Bin
    Xu, Meng
    [J]. Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2019, 48 (04): : 553 - 559
  • [2] UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning
    ZHANG Jiandong
    YANG Qiming
    SHI Guoqing
    LU Yi
    WU Yong
    [J]. Journal of Systems Engineering and Electronics, 2021, 32 (06) : 1421 - 1438
  • [3] UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning
    Zhang Jiandong
    Yang Qiming
    Shi Guoqing
    Lu Yi
    Wu Yong
    [J]. JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2021, 32 (06) : 1421 - 1438
  • [4] A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
    Li, Ke
    Zhang, Kun
    Zhang, Zhenchong
    Liu, Zekun
    Hua, Shuai
    He, Jianliang
    [J]. SENSORS, 2021, 21 (06)
  • [5] Maneuver Decision of UAV in Short-Range Air Combat Based on Deep Reinforcement Learning
    Yang, Qiming
    Zhang, Jiandong
    Shi, Guoqing
    Hu, Jinwen
    Wu, Yong
    [J]. IEEE ACCESS, 2020, 8 : 363 - 378
  • [6] UAVs Maneuver Decision-Making Method Based on Transfer Reinforcement Learning
    Zhu, Jindong
    Fu, Xiaowei
    Qiao, Zhe
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022 : 2399796
  • [7] UAV swarm air combat maneuver decision-making method based on multi-agent reinforcement learning and transferring
    Zheng, Zhiqiang
    Wei, Chen
    Duan, Haibin
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (08)
  • [8] UAV swarm air combat maneuver decision-making method based on multi-agent reinforcement learning and transferring
    Zhiqiang ZHENG
    Chen WEI
    Haibin DUAN
    [J]. ScienceChina(InformationSciences)., 2024, 67 (08) - 66
  • [9] Research on Air Confrontation Maneuver Decision-Making Method Based on Reinforcement Learning
    Zhang, Xianbing
    Liu, Guoqing
    Yang, Chaojie
    Wu, Jiang
    [J]. ELECTRONICS, 2018, 7 (11):
  • [10] A novel action decision method of deep reinforcement learning based on a neural network and confidence bound
    Wenhao Zhang
    Yaqing Song
    Xiangpeng Liu
    Qianqian Shangguan
    Kang An
    [J]. Applied Intelligence, 2023, 53 : 21299 - 21311