Reentry trajectory optimization based on Deep Reinforcement Learning

被引:2
|
作者
Gao, Jiashi [1 ]
Shi, Xinming [1 ]
Cheng, Zhongtao [1 ]
Xiong, Jizhang [1 ]
Liu, Lei [1 ]
Wang, Yongji [1 ]
Yang, Ye [2 ]
机构
[1] Huazhong Univ Sci & Technol, Wuhan 430074, Peoples R China
[2] Beijing Aerosp Automat Control Inst, Sci & Technol Aerosp Intelligent Control Lab, 50 Yong Ding Rd, Beijing 100854, Peoples R China
基金
中国国家自然科学基金;
关键词
Reentry trajectory optimization; Deep Reinforcement Learning;
D O I
10.1109/ccdc.2019.8832559
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article solved the reentry optimization problem of REV using the Deep Reinforcement Learning-Deep Deterministic Policy Gradient (DDPG) method for continuous system decision making. Compared with the traditional intelligent optimization algorithm, the DDPG algorithm trains appropriate action values for each state value during flight by constructing the action neural network and the critic neural network, avoiding the problems caused by the improper segmentation of traditional intelligent algorithms. And through the greedy algorithm, the optimization process is prevented from falling into local optimum. By comparing the trajectory optimization results with the particle swarm optimization algorithm, the effectiveness of the DDPG algorithm is verified. At the same time, the optimized trajectory of the DDPG algorithm has better smoothness, and the optimization process is not easy to fall into the local maximum.
引用
下载
收藏
页码:2588 / 2592
页数:5
相关论文
共 50 条
  • [1] Trajectory optimization algorithm of skipping missile based on deep reinforcement learning
    Gong K.
    Wei H.
    Li J.
    Song X.
    Li Y.
    Li Y.
    Zhang Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (06): : 1383 - 1393
  • [2] Trajectory Optimization for 6G-UAV Based on Deep Reinforcement Learning
    Cui H.
    Zhang N.
    Liu P.
    IEEE Transactions on Vehicular Technology, 2024, 73 (11) : 1 - 5
  • [3] Deep reinforcement learning based trajectory optimization for UAV-enabled IoT with SWIPT
    Yang, Yuwen
    Liu, Xin
    AD HOC NETWORKS, 2024, 159
  • [4] A Deep Reinforcement Learning Approach for Federated Learning Optimization with UAV Trajectory Planning
    Zhang, Chunyu
    Liu, Yiming
    Zhang, Zhi
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [5] Learning Basketball Dribbling Skills Using Trajectory Optimization and Deep Reinforcement Learning
    Liu, Libin
    Hodgins, Jessica
    ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04):
  • [6] Deep reinforcement learning based trajectory optimization for magnetometer-mounted UAV to landmine detection
    Barnawi, Ahmed
    Kumar, Neeraj
    Budhiraja, Ishan
    Kumar, Krishan
    Almansour, Amal
    Alzahrani, Bander
    COMPUTER COMMUNICATIONS, 2022, 195 : 441 - 450
  • [7] Multi-Agent Deep Reinforcement Learning Based UAV Trajectory Optimization for Differentiated Services
    Ning, Zhaolong
    Yang, Yuxuan
    Wang, Xiaojie
    Song, Qingyang
    Guo, Lei
    Jamalipour, Abbas
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 5818 - 5834
  • [8] Intelligent optimization of horizontal wellbore trajectory based on reinforcement learning
    Sun, Shihui
    Gao, Yanwen
    Sun, Xiaofeng
    Wu, Jun
    Chang, Huilin
    Geoenergy Science and Engineering, 2025, 244
  • [9] Deep Reinforcement Learning Assisted UAV Trajectory and Resource Optimization for NOMA Networks
    Chen, Peixin
    Zhao, Jian
    Shen, Furao
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 933 - 938
  • [10] UAV Trajectory Optimization for Directional THz Links Using Deep Reinforcement Learning
    Dabiri, Mohammad Taghi
    Hasn, Mazen
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,