Event-triggered reinforcement learning control for the quadrotor UAV with actuator saturation

被引:33
|
作者
Lin, Xiaobo [1 ]
Liu, Jian [2 ]
Yu, Yao [1 ]
Sun, Changyin [2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Quadrotor; UAV; Reinforcement learning; Flight control; Event-triggered control; Actuator saturation; TRACKING CONTROL;
D O I
10.1016/j.neucom.2020.07.042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an event-triggered reinforcement learning (RL) control strategy to stabilize the quadrotor unmanned aerial vehicle (UAV) with actuator saturation. As the quadrotor UAV equips with a complex dynamic is difficult to be model accurately, a model free reinforcement learning scheme is designed. Due to the practical limitation of actuators, the end of controller is constrained with a bounded function. In order to reduce the calculation consumption for the onboard computer, an event-triggered mechanism is developed, which only update the controller when the triggered condition is satisfied. The proposed controller is implemented with two neural networks which are called critic and actor. Some advanced RL technologies are utilized for speeding up the train process, e.g. off-policy training, experience replay, etc. The stability of closed-loop system is proved by the Lyapunov analysis. The simulation results including a stability task and a tracking task verify the theoretical analysis, in which we find the updating frequency of controller is decreased greatly. (C) 2020 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:135 / 145
页数:11
相关论文
共 50 条
  • [41] Adaptive event-triggered control for quadrotor aircraft with output constraints
    Wang, Jie
    Wang, Ping
    Ma, Xiao
    AEROSPACE SCIENCE AND TECHNOLOGY, 2020, 105 (105)
  • [42] Dynamic Event-Triggered Formation Control for Multiple Quadrotor UAVs
    Wang Hongbin
    Zhou Zhen
    Wang Yueling
    Zhang Mingquan
    Xue Xiaojun
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 6590 - 6595
  • [43] A waiting time based discrete event-triggered control for networked switched systems with actuator saturation ?
    Qi, Yiwen
    Xu, Xindi
    Lu, Shaowei
    Yu, Yongtao
    NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2020, 37
  • [44] Dynamic Output Feedback Control for Systems Subject to Actuator Saturation via Event-Triggered Scheme
    Li, Hongchao
    Zuo, Zhiqiang
    Wang, Yijing
    ASIAN JOURNAL OF CONTROL, 2018, 20 (01) : 207 - 215
  • [45] Co-design of event-triggered control for discrete-time systems with actuator saturation
    Zuo, Zhiqiang
    Li, Qingsong
    Li, Hongchao
    Wang, Yijing
    PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 170 - 175
  • [46] Event-triggered average dwell time control for switched uncertain linear systems with actuator saturation
    Cui, Yanliang
    Xu, Lanlan
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2018, 49 (08) : 1715 - 1724
  • [47] Event-triggered distributed optimal consensus control for multi-agent systems with actuator saturation
    Wang, Dong
    Huang, Yun
    Wang, Wei
    Zhao, Jun
    Wang, Linqing
    2019 12TH ASIAN CONTROL CONFERENCE (ASCC), 2019, : 943 - 948
  • [48] Event-triggered control for unmanned sailboat with actuator failures
    Li J.
    Zhang G.
    Huang C.
    Zhang W.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2022, 44 (01): : 242 - 249
  • [49] Event-triggered reinforcement learning H∞ control design for constrained-input nonlinear systems subject to actuator failures
    Liang, Yuling
    Zhang, Huaguang
    Duan, Jie
    Sun, Shaoxin
    INFORMATION SCIENCES, 2021, 543 : 273 - 295
  • [50] Event-triggered integral reinforcement learning for nonzero-sum games with asymmetric input saturation
    Xue, Shan
    Luo, Biao
    Liu, Derong
    Gao, Ying
    NEURAL NETWORKS, 2022, 152 : 212 - 223