Near-optimal Trajectory Tracking in Quadcopters using Reinforcement Learning

被引:0
|
作者
Engelhardt, Randal [1 ]
Velazquez, Alberto [2 ]
Sardarmehni, Tohid [1 ]
机构
[1] Calif State Univ Northridge, Mech Engn, Northridge, CA 91330 USA
[2] Univ Texas Rio Grande Valley, Mech Engn, Edinburg, TX 78539 USA
来源
IFAC PAPERSONLINE | 2024年 / 58卷 / 28期
关键词
Optimal Control; Reinforcement Learning; Quadcopter; MODEL-PREDICTIVE CONTROL; QUADROTOR;
D O I
10.1016/j.ifacol.2024.12.011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The control of quadcopters poses significant challenges due to their complex dynamics characterized by highly nonlinear couplings, high system order, and under-actuation. This paper presents a novel control solution aimed at achieving near-optimal trajectory tracking for quadcopters. A near-optimal solution based on approximate dynamic programming is proposed to address the curse of dimensionality inherent in traditional dynamic programming, employing a single network adaptive critic. Extensive simulations validate the effectiveness and robustness of the proposed solution.
引用
收藏
页码:61 / 65
页数:5
相关论文
共 50 条
  • [41] Near-optimal dynamic trajectory generation and control of an omnidirectional vehicle
    Kalmár-Nagy, T
    D'Andrea, R
    Ganguly, P
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2004, 46 (01) : 47 - 64
  • [42] Kernel-based multiagent reinforcement learning for near-optimal formation control of mobile robots
    Ronghua Zhang
    Xin Xu
    Xinglong Zhang
    Quan Xiong
    Qingwen Ma
    Yaoqian Peng
    Applied Intelligence, 2023, 53 : 12736 - 12748
  • [43] Near-optimal learning with average Holder smoothness
    Hanneke, Steve
    Kontorovich, Aryeh
    Kornowski, Guy
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [44] A reinforcement learning-based near-optimal hierarchical approach for motion control: Design and experiment
    Qin, Zhi-Chang
    Zhu, Hai-Tao
    Wang, Shou-Jun
    Xin, Ying
    Sun, Jian-Qiao
    ISA TRANSACTIONS, 2022, 129 : 673 - 683
  • [45] Predicting the Near-Optimal Mesh Spacing for a Simulation Using Machine Learning
    Lock, Callum
    Hassan, Oubay
    Sevilla, Ruben
    Jones, Jason
    SIAM INTERNATIONAL MESHING ROUNDTABLE 2023, SIAM IMR 2023, 2024, 147 : 115 - 136
  • [46] Near-optimal energy management for plug-in hybrid fuel cell and battery propulsion using deep reinforcement learning
    Wu, Peng
    Partridge, Julius
    Anderlini, Enrico
    Liu, Yuanchang
    Bucknall, Richard
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2021, 46 (80) : 40022 - 40040
  • [47] Kernel-based multiagent reinforcement learning for near-optimal formation control of mobile robots
    Zhang, Ronghua
    Xu, Xin
    Zhang, Xinglong
    Xiong, Quan
    Ma, Qingwen
    Peng, Yaoqian
    APPLIED INTELLIGENCE, 2023, 53 (10) : 12736 - 12748
  • [48] Reinforcement Learning-Based Near-Optimal Load Balancing for Heterogeneous LiFi WiFi Network
    Ahmad, Rizwana
    Soltani, Mohammad Dehghani
    Safari, Majid
    Srivastava, Anand
    IEEE SYSTEMS JOURNAL, 2022, 16 (02): : 3084 - 3095
  • [49] A near-optimal reinforcement learning scheme for energy efficient point-to-point wireless communications
    Pandana, C
    Liu, KJR
    GLOBECOM '04: IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-6, 2004, : 763 - 767
  • [50] Risk-Sensitive Reinforcement Learning: Near-Optimal Risk-Sample Tradeoff in Regret
    Fei, Yingjie
    Yang, Zhuoran
    Chen, Yudong
    Wang, Zhaoran
    Xie, Qiaomin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33