Adaptive Trajectory Tracking Control using Reinforcement Learning for Quadrotor

被引:12
|
作者
Lou, Wenjie [1 ]
Guo, Xiao [2 ]
机构
[1] Beihang Univ, Sch Aeronaut Sci & Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Reinforcement Learning; Adaptive Control; Quadrotor;
D O I
10.5772/62128
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Inaccurate system parameters and unpredicted external disturbances affect the performance of non-linear controllers. In this paper, a new adaptive control algorithm under the reinforcement framework is proposed to stabilize a quadrotor helicopter. Based on a command-filtered nonlinear control algorithm, adaptive elements are added and learned by policy-search methods. To predict the inaccurate system parameters, a new kernel-based regression learning method is provided. In addition, Policy learning by Weighting Exploration with the Returns (PoWER) and Return Weighted Regression (RWR) are utilized to learn the appropriate parameters for adaptive elements in order to cancel the effect of external disturbance. Furthermore, numerical simulations under several conditions are performed, and the ability of adaptive trajectory-tracking control with reinforcement learning are demonstrated.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Trajectory Tracking with Adaptive Robust Control for Quadrotor
    Espinoza-Fraire, Tadeo
    Saenz, Armando
    Salas, Francisco
    Juarez, Raymundo
    Giernacki, Wojciech
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (18):
  • [2] Adaptive dynamic control of a quadrotor for trajectory tracking
    Rosales, Claudio
    Soria, Carlos
    Carelli, Ricardo
    Rossomando, Francisco
    [J]. 2017 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'17), 2017, : 547 - 553
  • [3] Adaptive Dynamic Control for Trajectory Tracking with a Quadrotor
    Santos, Milton
    Rosales, Claudio
    Sarapura, Jorge
    Sarcinelli-Filho, Mario
    Carelli, Ricardo
    [J]. 2017 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'17), 2017, : 143 - 149
  • [4] DATT: Deep Adaptive Trajectory Tracking for Quadrotor Control
    Huang, Kevin
    Rana, Rwik
    Spitzer, Alexander
    Shi, Guanya
    Boots, Byron
    [J]. CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229
  • [5] Adaptive Trajectory Tracking Control of a Quadrotor Unmanned Aircraft
    Zuo Zongyu
    [J]. 2011 30TH CHINESE CONTROL CONFERENCE (CCC), 2011, : 2435 - 2439
  • [6] Adaptive Integral Backstepping Control for Trajectory Tracking of a Quadrotor
    Fan, Yunsheng
    Cao, Yabo
    Li, Tieshan
    [J]. 2017 4TH INTERNATIONAL CONFERENCE ON INFORMATION, CYBERNETICS AND COMPUTATIONAL SOCIAL SYSTEMS (ICCSS), 2017, : 619 - 624
  • [7] Modeling and Adaptive Flight Control for Quadrotor Trajectory Tracking
    Bouadi, Hakim
    Mora-Camino, F.
    [J]. JOURNAL OF AIRCRAFT, 2018, 55 (02): : 666 - 681
  • [8] Adaptive Control for Quadrotor Trajectory Tracking With Accurate Parametrization
    Perez-Alcocer, Ricardo
    Moreno-Valenzuela, Javier
    [J]. IEEE ACCESS, 2019, 7 : 53236 - 53247
  • [9] Adaptive optimal trajectory tracking control of AUVs based on reinforcement learning
    Li, Zhifu
    Wang, Ming
    Ma, Ge
    [J]. ISA TRANSACTIONS, 2023, 137 : 122 - 132
  • [10] Robust Optimal Adaptive Trajectory Tracking Control of Quadrotor Helicopter
    Navabi, M.
    Mirzaei, H.
    [J]. LATIN AMERICAN JOURNAL OF SOLIDS AND STRUCTURES, 2017, 14 (06): : 1040 - 1063