Event-triggered reinforcement learning control for the quadrotor UAV with actuator saturation

被引:33
|
作者
Lin, Xiaobo [1 ]
Liu, Jian [2 ]
Yu, Yao [1 ]
Sun, Changyin [2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Quadrotor; UAV; Reinforcement learning; Flight control; Event-triggered control; Actuator saturation; TRACKING CONTROL;
D O I
10.1016/j.neucom.2020.07.042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an event-triggered reinforcement learning (RL) control strategy to stabilize the quadrotor unmanned aerial vehicle (UAV) with actuator saturation. As the quadrotor UAV equips with a complex dynamic is difficult to be model accurately, a model free reinforcement learning scheme is designed. Due to the practical limitation of actuators, the end of controller is constrained with a bounded function. In order to reduce the calculation consumption for the onboard computer, an event-triggered mechanism is developed, which only update the controller when the triggered condition is satisfied. The proposed controller is implemented with two neural networks which are called critic and actor. Some advanced RL technologies are utilized for speeding up the train process, e.g. off-policy training, experience replay, etc. The stability of closed-loop system is proved by the Lyapunov analysis. The simulation results including a stability task and a tracking task verify the theoretical analysis, in which we find the updating frequency of controller is decreased greatly. (C) 2020 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:135 / 145
页数:11
相关论文
共 50 条
  • [31] Event-triggered non-fragile control for linear systems with actuator saturation and disturbances
    Liu, Dan
    Yang, Guang-Hong
    INFORMATION SCIENCES, 2018, 429 : 1 - 11
  • [32] Event-triggered Control of Positive Switched Systems with Actuator Saturation and Time-delay
    Jun-Feng Zhang
    Lai-You Liu
    Shi-Zhou Fu
    Shuo Li
    International Journal of Automation and Computing, 2021, 18 : 141 - 154
  • [33] Event-triggered Control of Positive Switched Systems with Actuator Saturation and Time-delay
    Jun-Feng Zhang
    Lai-You Liu
    Shi-Zhou Fu
    Shuo Li
    Machine Intelligence Research, 2021, 18 (01) : 141 - 154
  • [34] Event-Triggered Optimal Formation Tracking Control Using Reinforcement Learning for Large-Scale UAV Systems
    Yan, Ziwei
    Han, Liang
    Li, Xiaoduo
    Li, Jinjie
    Ren, Zhang
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 3233 - 3239
  • [35] Dynamic Event-Triggered Reinforcement Learning Control of Stochastic Nonlinear Systems
    Zhu, Hao-Yang
    Li, Yuan-Xin
    Tong, Shaocheng
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2023, 31 (09) : 2917 - 2928
  • [36] Dynamic event-triggered neuroadaptive fault-tolerant control of quadrotor UAV with a novel cosine kernel
    Sarkar, Nabarun
    Deb, Alok Kanti
    Aerospace Science and Technology, 2024, 155
  • [37] Attitude Stabilization of a Quadrotor by Means of Event-Triggered Nonlinear Control
    Guerrero-Castellanos, J. F.
    Tellez-Guzman, J. J.
    Durand, S.
    Marchand, N.
    Alvarez-Munoz, J. U.
    Gonzalez-Diaz, V. R.
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2014, 73 (1-4) : 123 - 135
  • [38] Learning observer based and event-triggered control to spacecraft against actuator faults
    Zhang, Chengxi
    Wang, Jihe
    Zhang, Dexin
    Shao, Xiaowei
    AEROSPACE SCIENCE AND TECHNOLOGY, 2018, 78 : 522 - 530
  • [39] Attitude Stabilization of a Quadrotor by Means of Event-Triggered Nonlinear Control
    J. F. Guerrero-Castellanos
    J. J. Téllez-Guzmán
    S. Durand
    N. Marchand
    J. U. Alvarez-Muñoz
    V. R. González-Díaz
    Journal of Intelligent & Robotic Systems, 2014, 73 : 123 - 135
  • [40] Event-triggered control for uncertain delayed neural networks with actuator saturation against deception attack
    Tian, Mingyang
    Duan, Chunmei
    INTERNATIONAL JOURNAL OF CONTROL, 2024, 97 (03) : 554 - 566