Multiconstrained Gliding Guidance Based on Optimal and Reinforcement Learning Method

被引:5
|
作者
Zhe, Luo [1 ]
Xinsan, Li [1 ,2 ]
Lixin, Wang [1 ]
Qiang, Shen [1 ]
机构
[1] Xian High Tech Inst, Xian 710025, Peoples R China
[2] Northwest Univ, Sch Astronaut, Xian 710072, Peoples R China
关键词
ALGORITHM;
D O I
10.1155/2021/6652232
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In order to improve the autonomy of gliding guidance for complex flight missions, this paper proposes a multiconstrained intelligent gliding guidance strategy based on optimal guidance and reinforcement learning (RL). Three-dimensional optimal guidance is introduced to meet the terminal latitude, longitude, altitude, and flight-path-angle constraints. A velocity control strategy through lateral sinusoidal maneuver is proposed, and an analytical terminal velocity prediction method considering maneuvering flight is studied. Aiming at the problem that the maneuvering amplitude in velocity control cannot be determined offline, an intelligent parameter adjustment method based on RL is studied. This method considers parameter determination as a Markov Decision Process (MDP) and designs a state space via terminal speed and an action space with maneuvering amplitude. In addition, it constructs a reward function that integrates terminal velocity error and gliding guidance tasks and uses Q-Learning to achieve the online intelligent adjustment of maneuvering amplitude. The simulation results show that the intelligent gliding guidance method can meet various terminal constraints with high accuracy and can improve the autonomous decision-making ability under complex tasks effectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Real-Time Optimal Power Flow Method via Safe Deep Reinforcement Learning Based on Primal-Dual and Prior Knowledge Guidance
    Wu, Pengfei
    Chen, Chen
    Lai, Dexiang
    Zhong, Jian
    Bie, Zhaohong
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2025, 40 (01) : 597 - 611
  • [42] Real-Time Multiconstrained Polynomial Guidance Based on Analytical Gradient Derivation
    Shi, Peng
    Guan, Siyue
    Cheng, Lin
    Li, Wenlong
    Huang, Xu
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (02) : 1711 - 1721
  • [43] Accelerating Reinforcement Learning with Suboptimal Guidance
    Bohn, Eivind
    Moe, Signe
    Johansen, Tor Arne
    IFAC PAPERSONLINE, 2020, 53 (02): : 8090 - 8096
  • [44] Integrating guidance into relational reinforcement learning
    Driessens, K
    Dzeroski, S
    MACHINE LEARNING, 2004, 57 (03) : 271 - 304
  • [45] Certified reinforcement learning with logic guidance
    Hasanbeig, Hosein
    Kroening, Daniel
    Abate, Alessandro
    ARTIFICIAL INTELLIGENCE, 2023, 322
  • [46] ADAPTIVE GUIDANCE WITH REINFORCEMENT META LEARNING
    Gaudet, Brian
    Linares, Richard
    SPACEFLIGHT MECHANICS 2019, VOL 168, PTS I-IV, 2019, 168 : 4091 - 4109
  • [47] Integrating Guidance into Relational Reinforcement Learning
    Kurt Driessens
    Sašo Džeroski
    Machine Learning, 2004, 57 : 271 - 304
  • [48] An Improved Reinforcement Learning Method Based on Unsupervised Learning
    Chang, Xin
    Li, Yanbin
    Zhang, Guanjie
    Liu, Donghui
    Fu, Changjun
    IEEE ACCESS, 2024, 12 : 12295 - 12307
  • [49] Reinforcement Learning Based Optimal Energy Management of A Microgrid
    Iqbal, Saqib
    Mehran, Kamyar
    2022 IEEE ENERGY CONVERSION CONGRESS AND EXPOSITION (ECCE), 2022,
  • [50] The Optimal Path Finding Algorithm Based on Reinforcement Learning
    Khekare, Ganesh
    Verma, Pushpneel
    Dhanre, Urvashi
    Raut, Seema
    Sheikh, Shahrukh
    INTERNATIONAL JOURNAL OF SOFTWARE SCIENCE AND COMPUTATIONAL INTELLIGENCE-IJSSCI, 2020, 12 (04): : 1 - 18