Deep Reinforcement Learning and L1 Adaptive Control Algorithm-Based Attitude Control of Fixed-Wing UAVs

被引:0
|
作者
Li, Xiaolu [1 ]
Wu, Jia'nan [1 ]
Qi, Chenyang [1 ]
Cong, Peiyan [1 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Peoples R China
关键词
Fixed-wing UAV; DDPG; L1 adaptive controller; Parameters tuning; Robustness;
D O I
10.1007/978-981-99-0479-2_212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The fixed-wing UAV is a nonlinear strongly coupled system. Although the traditional linear controller can achieve attitude control of the UAV, the controller parameters tuning process is tedious and the robustness of the system is weak, which greatly limits the performance of the UAV. To address the above problems, this paper proposes a comprehensive control scheme that uses the deep reinforcement learning algorithm DDPG to train the controller parameters to achieve automatic tuning of these parameters on the structure of the classical controller, while ensuring system stability by limiting the range of the control parameters, and then utilizes the L1 adaptive controller to improve the robustness of the system. First, we construct a fixed-wing UAV model and a PID controller framework as the training environment, and generate the value function of the reward feedback to the agent; then, the DDPG algorithm is applied to train the controller parameters to achieve stable control of the UAV; finally, the L1 adaptive algorithm is applied to enhance the robustness of the UAV attitude controller, and simulation results are presented. The results show that the DDPG-L1 adaptive control scheme designed in this paper can effectively solve the problem of tedious tuning of controller parameters and enhance the robustness of the system while ensuring the stability of the system.
引用
收藏
页码:2273 / 2285
页数:13
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs
    Zhen, Yan
    Hao, Mingrui
    Sun, Wendi
    PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 239 - 244
  • [2] Cooperative formation control of fixed-wing UAVs based on deep reinforcement learning
    Yue, Keyuan
    Yuan, Jianquan
    Hao, Mingrui
    SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [3] Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy Optimization
    Bohn, Eivind
    Coates, Erlend M.
    Moe, Signe
    Johansen, Tor Arne
    2019 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS' 19), 2019, : 523 - 533
  • [4] Data-Efficient Deep Reinforcement Learning for Attitude Control of Fixed-Wing UAVs: Field Experiments
    Bohn, Eivind
    Coates, Erlend M.
    Reinhardt, Dirk
    Johansen, Tor Arne
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3168 - 3180
  • [5] Robust Attitude Tracking Control for Fixed-Wing UAVs
    Wang, Mingdong
    Shi, Zongying
    Zhong, Yisheng
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 2340 - 2346
  • [6] Leader-Follower Formation Control for Fixed-Wing UAVs using Deep Reinforcement Learning
    Shi, Yu
    Song, Jianshuang
    Hua, Yongzhao
    Yu, Jianglong
    Dong, Xiwang
    Ren, Zhang
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3456 - 3461
  • [7] Fixed-Wing Stalled Maneuver Control Technology Based on Deep Reinforcement Learning
    Hu, Weijun
    Gao, Zhiqiang
    Quan, Jiale
    Ma, Xianlong
    Xiong, Jingyi
    Zhang, Weijie
    2022 IEEE THE 5TH INTERNATIONAL CONFERENCE ON BIG DATA AND ARTIFICIAL INTELLIGENCE (BDAI 2022), 2022, : 19 - 25
  • [8] Geometric Reduced-Attitude Control of Fixed-Wing UAVs
    Coates, Erlend M.
    Fossen, Thor, I
    APPLIED SCIENCES-BASEL, 2021, 11 (07):
  • [9] Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs
    Zhao, Yu
    Guo, Jifeng
    Bai, Chengchao
    Zheng, Hongxing
    COMPLEXITY, 2021, 2021
  • [10] A Novel Backstepping Control for Attitude of Fixed-wing UAVs with Input Disturbance
    Zhao, Shulong
    Wang, Xiangke
    Kong, Weiwei
    Zhang, Daibing
    Shen, Lincheng
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 693 - 697