Event-triggered reinforcement learning control for the quadrotor UAV with actuator saturation

被引:33
|
作者
Lin, Xiaobo [1 ]
Liu, Jian [2 ]
Yu, Yao [1 ]
Sun, Changyin [2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Quadrotor; UAV; Reinforcement learning; Flight control; Event-triggered control; Actuator saturation; TRACKING CONTROL;
D O I
10.1016/j.neucom.2020.07.042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an event-triggered reinforcement learning (RL) control strategy to stabilize the quadrotor unmanned aerial vehicle (UAV) with actuator saturation. As the quadrotor UAV equips with a complex dynamic is difficult to be model accurately, a model free reinforcement learning scheme is designed. Due to the practical limitation of actuators, the end of controller is constrained with a bounded function. In order to reduce the calculation consumption for the onboard computer, an event-triggered mechanism is developed, which only update the controller when the triggered condition is satisfied. The proposed controller is implemented with two neural networks which are called critic and actor. Some advanced RL technologies are utilized for speeding up the train process, e.g. off-policy training, experience replay, etc. The stability of closed-loop system is proved by the Lyapunov analysis. The simulation results including a stability task and a tracking task verify the theoretical analysis, in which we find the updating frequency of controller is decreased greatly. (C) 2020 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:135 / 145
页数:11
相关论文
共 50 条
  • [1] Integral reinforcement learning based event-triggered control with input saturation
    Xue, Shan
    Luo, Biao
    Liu, Derong
    NEURAL NETWORKS, 2020, 131 : 144 - 153
  • [2] Event-Triggered Attack-Tolerant Control for Quadrotor UAV
    Li, Haiming
    Zheng, Shiqi
    Zhao, Chenghao
    Jian, Haitao
    Wang, Shihao
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 2292 - 2297
  • [3] Event-triggered Adaptive Attitude Tracking Control of a Quadrotor UAV
    Zeng, Weiquan
    Fan, Huijin
    Wang, Wei
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 2855 - 2860
  • [4] Event-triggered control for switched systems in the presence of actuator saturation
    Zuo, Zhiqiang
    Li, Yuanyuan
    Wang, Yijing
    Li, Hongchao
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2018, 49 (07) : 1478 - 1490
  • [5] Event-triggered control for positive linear systems with actuator saturation
    Yang G.-J.
    Hao F.
    Zhang L.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (07): : 1304 - 1312
  • [6] Event-triggered synchronization control for complex networks with actuator saturation
    Liu, Dan
    Yang, Guang-Hong
    NEUROCOMPUTING, 2018, 275 : 2209 - 2216
  • [7] Event-triggered control for linear systems with actuator saturation and disturbances
    Liu, Dan
    Yang, Guang-Hong
    IET CONTROL THEORY AND APPLICATIONS, 2017, 11 (09): : 1351 - 1359
  • [8] Switching event-triggered control of switched systems with actuator saturation
    Li, Zhihui
    Wang, Yue-E
    Wu, Di
    ASIAN JOURNAL OF CONTROL, 2023, 25 (03) : 2276 - 2285
  • [9] Deep Reinforcement Learning for Event-Triggered Control
    Baumann, Dominik
    Zhu, Jia-Jie
    Martius, Georg
    Trimpe, Sebastian
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 943 - 950
  • [10] Event-triggered and self-triggered control for linear systems with actuator saturation
    Zuo, Zhiqiang
    Li, Qingsong
    Li, Hongchao
    Wang, Yijing
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2018, 40 (04) : 1281 - 1288