Waypoint Navigation of Quadrotor using Deep Reinforcement Learning

被引:0
|
作者
Himanshu, K. Harikumar [1 ]
Pushpangathan, Jinraj, V [1 ]
机构
[1] Int Inst Informat Technol Hyderabad, Hyderabad, India
来源
IFAC PAPERSONLINE | 2022年 / 55卷 / 22期
关键词
Reinforcement learning control; Tracking; Navigation; UAVs; Intelligent robotics;
D O I
10.1016/j.ifaco1.2023.03.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Reinforcement Learning (RL) based technique to develop a simple neural network controller for the task of waypoint navigation in quadrotors. In this paper, the application of Twin Delayed Deep Deterministic (TD3) Policy Gradient algorithm for high and low-level control implementation for quadrotors is discussed. The proposed methods are tested on high fidelity Gym-Pybullet-Drones simulator. The effectiveness of the methods developed is validated through numerical simulations. The simulation results indicate that both control policies are successful in navigating through the assigned waypoint, with the low-level controller being accurate in the nominal flight conditions. In the presence of disturbance inputs, the high-level controller performs better when compared to the low-level controller.
引用
下载
收藏
页码:281 / 286
页数:6
相关论文
共 50 条
  • [31] Deep reinforcement learning for quadrotor path following with adaptive velocity
    Bartomeu Rubí
    Bernardo Morcego
    Ramon Pérez
    Autonomous Robots, 2021, 45 : 119 - 134
  • [32] Deep reinforcement learning for quadrotor path following with adaptive velocity
    Rubi, Bartomeu
    Morcego, Bernardo
    Perez, Ramon
    AUTONOMOUS ROBOTS, 2021, 45 (01) : 119 - 134
  • [33] Deep Reinforcement Learning for Mobile Robot Navigation
    Gromniak, Martin
    Stenzel, Jonas
    2019 4TH ASIA-PACIFIC CONFERENCE ON INTELLIGENT ROBOT SYSTEMS (ACIRS 2019), 2019, : 68 - 73
  • [34] Three-Dimensional Waypoint Navigation of Multicopters by Attitude and Throttle Commands using Off-Policy Reinforcement Learning
    d'Apolito, Francesco
    Sulzbachner, Christoph
    2022 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS), 2022, : 1359 - 1366
  • [35] Controller Design for Quadrotor UAVs using Reinforcement Learning
    Bou-Ammar, Haitham
    Voos, Holger
    Ertel, Wolfgang
    2010 IEEE INTERNATIONAL CONFERENCE ON CONTROL APPLICATIONS, 2010, : 2130 - 2135
  • [36] Connecting Deep-Reinforcement-Learning-based Obstacle Avoidance with Conventional Global Planners using Waypoint Generators
    Kaestner, Linh
    Zhao, Xinlin
    Buiyan, Teham
    Li, Junhui
    Shen, Zhengcheng
    Lambrecht, Jens
    Marx, Cornelius
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 1213 - 1220
  • [37] Reliable UAV Navigation Using Cellular Networks: A Deep Reinforcement Learning Approach
    Afifi, Ghada
    Gadallah, Yasser
    2024 IEEE INTERNATIONAL BLACK SEA CONFERENCE ON COMMUNICATIONS AND NETWORKING, BLACKSEACOM 2024, 2024, : 30 - 35
  • [38] All Aware Robot Navigation in Human Environments Using Deep Reinforcement Learning
    Lu, Xiaojun
    Faragasso, Angela
    Yamashita, Atsushi
    Asama, Hajime
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5989 - 5996
  • [39] Robot Navigation of Environments with Unknown Rough Terrain Using Deep Reinforcement Learning
    Zhang, Kaicheng
    Niroui, Farzad
    Ficocelli, Maurizio
    Nejat, Goldie
    2018 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS (SSRR), 2018,
  • [40] Sim-to-Real: Mapless Navigation for USVs Using Deep Reinforcement Learning
    Wang, Ning
    Wang, Yabiao
    Zhao, Yuming
    Wang, Yong
    Li, Zhigang
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (07)