Near-optimal Trajectory Tracking in Quadcopters using Reinforcement Learning

被引:0
|
作者
Engelhardt, Randal [1 ]
Velazquez, Alberto [2 ]
Sardarmehni, Tohid [1 ]
机构
[1] Calif State Univ Northridge, Mech Engn, Northridge, CA 91330 USA
[2] Univ Texas Rio Grande Valley, Mech Engn, Edinburg, TX 78539 USA
来源
IFAC PAPERSONLINE | 2024年 / 58卷 / 28期
关键词
Optimal Control; Reinforcement Learning; Quadcopter; MODEL-PREDICTIVE CONTROL; QUADROTOR;
D O I
10.1016/j.ifacol.2024.12.011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The control of quadcopters poses significant challenges due to their complex dynamics characterized by highly nonlinear couplings, high system order, and under-actuation. This paper presents a novel control solution aimed at achieving near-optimal trajectory tracking for quadcopters. A near-optimal solution based on approximate dynamic programming is proposed to address the curse of dimensionality inherent in traditional dynamic programming, employing a single network adaptive critic. Extensive simulations validate the effectiveness and robustness of the proposed solution.
引用
收藏
页码:61 / 65
页数:5
相关论文
共 50 条
  • [31] Controller exploitation-exploration reinforcement learning architecture for computing near-optimal policies
    Erick Asiain
    Julio B. Clempner
    Alexander S. Poznyak
    Soft Computing, 2019, 23 : 3591 - 3604
  • [32] Near-Optimal Goal-Oriented Reinforcement Learning in Non-Stationary Environments
    Chen, Liyu
    Luo, Haipeng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [33] Reinforcement Learning for Near-Optimal Design of Zero-Delay Codes for Markov Sources
    Cregg, Liam
    Linder, Tamas
    Yuksel, Serdar
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (11) : 8399 - 8413
  • [34] Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning
    Yu-Qing Qiu
    Yan Li
    Zhong Wang
    International Journal of Control, Automation and Systems, 2023, 21 : 1319 - 1330
  • [35] MEC-A Near-Optimal Online Reinforcement Learning Algorithm for Continuous Deterministic Systems
    Zhao, Dongbin
    Zhu, Yuanheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (02) : 346 - 356
  • [36] R-MAX - A general polynomial time algorithm for near-optimal reinforcement learning
    Brafman, RI
    Tennenholtz, M
    JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (02) : 213 - 231
  • [37] Deriving a Near-optimal Power Management Policy Using Model-Free Reinforcement Learning and Bayesian Classification
    Wang, Yanzhi
    Xie, Qing
    Ammari, Ahmed
    Pedram, Massoud
    PROCEEDINGS OF THE 48TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2011, : 41 - 46
  • [38] Optimal Trajectory Tracking for Unknown H∞ Constrained Systems Based on Reinforcement Learning
    Li, Xiaoqian
    Jing, Zonglei
    Ju, Peijun
    Zhao, Shufen
    Proceedings - 2023 China Automation Congress, CAC 2023, 2023, : 44 - 49
  • [39] Simultaneous stabilization with near-optimal model reference tracking
    Miller, D
    Kennedy, D
    SYSTEMS & CONTROL LETTERS, 2002, 46 (01) : 31 - 43
  • [40] RAPID NEAR-OPTIMAL AEROSPACE PLANE TRAJECTORY GENERATION AND GUIDANCE
    CORBAN, JE
    CALISE, AJ
    FLANDRO, GA
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 1991, 14 (06) : 1181 - 1190