Waypoint Navigation of Quadrotor using Deep Reinforcement Learning

被引:0
|
作者
Himanshu, K. Harikumar [1 ]
Pushpangathan, Jinraj, V [1 ]
机构
[1] Int Inst Informat Technol Hyderabad, Hyderabad, India
来源
IFAC PAPERSONLINE | 2022年 / 55卷 / 22期
关键词
Reinforcement learning control; Tracking; Navigation; UAVs; Intelligent robotics;
D O I
10.1016/j.ifaco1.2023.03.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Reinforcement Learning (RL) based technique to develop a simple neural network controller for the task of waypoint navigation in quadrotors. In this paper, the application of Twin Delayed Deep Deterministic (TD3) Policy Gradient algorithm for high and low-level control implementation for quadrotors is discussed. The proposed methods are tested on high fidelity Gym-Pybullet-Drones simulator. The effectiveness of the methods developed is validated through numerical simulations. The simulation results indicate that both control policies are successful in navigating through the assigned waypoint, with the low-level controller being accurate in the nominal flight conditions. In the presence of disturbance inputs, the high-level controller performs better when compared to the low-level controller.
引用
下载
收藏
页码:281 / 286
页数:6
相关论文
共 50 条
  • [1] Autonomous Navigation and Control of a Quadrotor Using Deep Reinforcement Learning
    Mokhtar, Mohamed
    El-Badawy, Ayman
    2023 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS, ICUAS, 2023, : 1045 - 1052
  • [2] Quadrotor navigation in dynamic environments with deep reinforcement learning
    Fang, Jinbao
    Sun, Qiyu
    Chen, Yukun
    Tang, Yang
    ASSEMBLY AUTOMATION, 2021, 41 (03) : 254 - 262
  • [3] Waypoint Tracking Control for a Quadrotor based on PID and Reinforcement Learning
    Bao, Xurui
    Jing, Zhouhui
    CONTROL ENGINEERING AND APPLIED INFORMATICS, 2023, 25 (01): : 90 - 100
  • [4] Quadrotor motion control using deep reinforcement learning
    Jiang, Zifei
    Lynch, Alan F.
    JOURNAL OF UNMANNED VEHICLE SYSTEMS, 2021, 9 (04) : 234 - 251
  • [5] Inclined Quadrotor Landing using Deep Reinforcement Learning
    Kooi, Jacob E.
    Babuska, Robert
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 2361 - 2368
  • [6] Quadrotor Waypoint Navigation and Trajectory Tracking Using Integral Backstepping Technique
    Zhang, Chuan-lian
    Chong, Kil-to
    2015 INTERNATIONAL CONFERENCE ON MECHANICAL ENGINEERING AND AUTOMATION (ICMEA 2015), 2015, : 102 - 106
  • [7] A Navigation Scheme for a Random Maze using Reinforcement Learning with Quadrotor Vision
    Yu, Xinglin
    Wu, Yuhu
    Sun, Xi-Ming
    2019 18TH EUROPEAN CONTROL CONFERENCE (ECC), 2019, : 518 - 523
  • [8] Reinforcement Learning-Based Optimal Multiple Waypoint Navigation
    Vlachos, Christos
    Rousseas, Panagiotis
    Bechlioulis, Charalampos P.
    Kyriakopoulos, Kostas J.
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 1537 - 1543
  • [9] Quadrotor Autonomous Navigation in Semi-Known Environments Based on Deep Reinforcement Learning
    Ou, Jiajun
    Guo, Xiao
    Lou, Wenjie
    Zhu, Ming
    REMOTE SENSING, 2021, 13 (21)
  • [10] Parallel Reinforcement Learning Simulation for Visual Quadrotor Navigation
    Saunders, Jack
    Saeedi, Sajad
    Li, Wenbin
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 1357 - 1363