Multiconstrained Gliding Guidance Based on Optimal and Reinforcement Learning Method

被引:5
|
作者
Zhe, Luo [1 ]
Xinsan, Li [1 ,2 ]
Lixin, Wang [1 ]
Qiang, Shen [1 ]
机构
[1] Xian High Tech Inst, Xian 710025, Peoples R China
[2] Northwest Univ, Sch Astronaut, Xian 710072, Peoples R China
关键词
ALGORITHM;
D O I
10.1155/2021/6652232
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In order to improve the autonomy of gliding guidance for complex flight missions, this paper proposes a multiconstrained intelligent gliding guidance strategy based on optimal guidance and reinforcement learning (RL). Three-dimensional optimal guidance is introduced to meet the terminal latitude, longitude, altitude, and flight-path-angle constraints. A velocity control strategy through lateral sinusoidal maneuver is proposed, and an analytical terminal velocity prediction method considering maneuvering flight is studied. Aiming at the problem that the maneuvering amplitude in velocity control cannot be determined offline, an intelligent parameter adjustment method based on RL is studied. This method considers parameter determination as a Markov Decision Process (MDP) and designs a state space via terminal speed and an action space with maneuvering amplitude. In addition, it constructs a reward function that integrates terminal velocity error and gliding guidance tasks and uses Q-Learning to achieve the online intelligent adjustment of maneuvering amplitude. The simulation results show that the intelligent gliding guidance method can meet various terminal constraints with high accuracy and can improve the autonomous decision-making ability under complex tasks effectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Crowd Evacuation Guidance Based on Combined Action Reinforcement Learning
    Xue, Yiran
    Wu, Rui
    Liu, Jiafeng
    Tang, Xianglong
    ALGORITHMS, 2021, 14 (01)
  • [32] Study on Reinforcement Learning-Based Missile Guidance Law
    Hong, Daseon
    Kim, Minjeong
    Park, Sungsu
    APPLIED SCIENCES-BASEL, 2020, 10 (18):
  • [33] Deep reinforcement learning-based robust missile guidance
    Ahn, Jeongsu
    Shin, Jongho
    Kim, Hyeong-Geun
    2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 927 - 930
  • [34] Intelligent guidance for no⁃fly zone avoidance based on reinforcement learning
    Hui J.
    Wang R.
    Guo J.
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2023, 44 (11):
  • [35] A Distributed Reinforcement Learning Guidance Method under Impact Angle Constraints
    Li B.
    An X.
    Yang X.
    Wu Y.
    Li G.
    Yuhang Xuebao/Journal of Astronautics, 2022, 43 (08): : 1061 - 1069
  • [36] Optimal control method of HVAC based on multi-agent deep reinforcement learning
    Fu, Qiming
    Chen, Xiyao
    Ma, Shuai
    Fang, Nengwei
    Xing, Bin
    Chen, Jianping
    ENERGY AND BUILDINGS, 2022, 270
  • [37] Reinforcement Learning-based Optimal On-board Decoupling Capacitor Design Method
    Park, Hyunwook
    Park, Junyong
    Kim, Subin
    Lho, Daehwan
    Park, Shinyoung
    Park, Gapyeol
    Cho, Kyungjun
    Kim, Joungho
    2018 IEEE 27TH CONFERENCE ON ELECTRICAL PERFORMANCE OF ELECTRONIC PACKAGING AND SYSTEMS (EPEPS), 2018, : 213 - 215
  • [38] A robust method based on reinforcement learning and differential evolution for the optimal photovoltaic parameter extraction
    Yu, Xiaobing
    Zhou, Jiaqi
    APPLIED SOFT COMPUTING, 2023, 148
  • [39] A Deep Reinforcement Learning-Based Optimal Transmission Control Method for Streaming Videos
    Yang, Yawen
    Xiao, Yuxuan
    IEEE ACCESS, 2024, 12 : 53088 - 53098
  • [40] Optimal Scheduling Method for Integrated Energy Systems with Hydrogen Based on Deep Reinforcement Learning
    Zhang, Lei
    Wu, Hongbin
    He, Ye
    Xu, Bin
    Zhang, Mingxing
    Ding, Ming
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2024, 48 (16): : 132 - 141