Missile Attitude Control Based on Deep Reinforcement Learning

被引:0
|
作者
Li, Bohao [1 ]
Ma, Fei [2 ]
Wu, Yunjie [3 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Beihang Univ, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
deep reinforcement learning; missile attitude control; DDPG; PID;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep reinforcement learning (DRL) has been one of the research hotspots in the areas of control. In this paper, we focus on the study of missile attitude control system using DRL. An novel PID controller based on deep deterministic policy gradient(DDPG) algorithm is presented, which could applied to the self-tuning of parameters. The framework of the adaptive DDPG-PID controller is given. The controller takes flight information as input and takes rudder angle as output. A reward function related to the system error is designed, which can be used to train the DDPG algorithm effectively. Simulation results show that the adaptive DDPG-PID controller has a faster convergence velocity, reduces the overshoot and oscillation, achieves higher accuracy tracking control to target.
引用
收藏
页码:931 / 936
页数:6
相关论文
共 50 条
  • [1] Satellite attitude control method based on deep reinforcement learning
    Wang Yuejiao
    Ma Zhong
    Yang Yidai
    Wang Zhuping
    Tang Lei
    [J]. CHINESE SPACE SCIENCE AND TECHNOLOGY, 2019, 39 (04) : 36 - 42
  • [2] Satellite Attitude Control with Deep Reinforcement Learning
    Gao, Duozhi
    Zhang, Haibo
    Li, Chuanjiang
    Gao, Xinzhou
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4095 - 4101
  • [3] Integrated Guidance and Control for Missile Using Deep Reinforcement Learning
    Pei, Pei
    He, Shao-Ming
    Wang, Jiang
    Lin, De-Fu
    [J]. Yuhang Xuebao/Journal of Astronautics, 2021, 42 (10): : 1293 - 1304
  • [4] Deep reinforcement learning-based robust missile guidance
    Ahn, Jeongsu
    Shin, Jongho
    Kim, Hyeong-Geun
    [J]. 2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 927 - 930
  • [5] Deep reinforcement learning-based attitude control for spacecraft using control moment gyros
    Oghim, Snyoll
    Park, Junwoo
    Bang, Hyochoong
    Leeghim, Henzeh
    [J]. Advances in Space Research, 2025, 75 (01) : 1129 - 1144
  • [6] Attitude Control of a Moving Mass-Actuated UAV Based on Deep Reinforcement Learning
    Qiu, Xiaoqi
    Gao, Changsheng
    Wang, Kefan
    Jing, Wuxing
    [J]. JOURNAL OF AEROSPACE ENGINEERING, 2022, 35 (02)
  • [7] Model-based deep reinforcement learning with heuristic search for satellite attitude control
    Xu, Ke
    Wu, Fengge
    Zhao, Junsuo
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2019, 46 (03): : 415 - 420
  • [8] Trajectory optimization algorithm of skipping missile based on deep reinforcement learning
    Gong, Kaiqi
    Wei, Hongkui
    Li, Jiawei
    Song, Xiao
    Li, Yong
    Li, Yixin
    Zhang, Yue
    [J]. Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (06): : 1383 - 1393
  • [9] Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs
    Zhen, Yan
    Hao, Mingrui
    Sun, Wendi
    [J]. PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 239 - 244
  • [10] Deep reinforcement learning method based on DDPG with simulated annealing for satellite attitude control system
    Su, Ruipeng
    Wu, Fengge
    Zhao, Junsuo
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 390 - 395