Waypoint Navigation of Quadrotor using Deep Reinforcement Learning

被引:0
|
作者
Himanshu, K. Harikumar [1 ]
Pushpangathan, Jinraj, V [1 ]
机构
[1] Int Inst Informat Technol Hyderabad, Hyderabad, India
来源
IFAC PAPERSONLINE | 2022年 / 55卷 / 22期
关键词
Reinforcement learning control; Tracking; Navigation; UAVs; Intelligent robotics;
D O I
10.1016/j.ifaco1.2023.03.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Reinforcement Learning (RL) based technique to develop a simple neural network controller for the task of waypoint navigation in quadrotors. In this paper, the application of Twin Delayed Deep Deterministic (TD3) Policy Gradient algorithm for high and low-level control implementation for quadrotors is discussed. The proposed methods are tested on high fidelity Gym-Pybullet-Drones simulator. The effectiveness of the methods developed is validated through numerical simulations. The simulation results indicate that both control policies are successful in navigating through the assigned waypoint, with the low-level controller being accurate in the nominal flight conditions. In the presence of disturbance inputs, the high-level controller performs better when compared to the low-level controller.
引用
下载
收藏
页码:281 / 286
页数:6
相关论文
共 50 条
  • [41] A Deep Reinforcement Learning Based Mapless Navigation Algorithm Using Continuous Actions
    Duo Nanxun
    Wang Qinzhao
    Lv Qiang
    Wei Heng
    Zhang Pei
    2019 INTERNATIONAL CONFERENCE ON ROBOTS & INTELLIGENT SYSTEM (ICRIS 2019), 2019, : 63 - 68
  • [42] Quadrotor Path Following and Reactive Obstacle Avoidance with Deep Reinforcement Learning
    Rubi, Bartomeu
    Morcego, Bernardo
    Perez, Ramon
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 103 (04)
  • [43] Quadrotor Path Following and Reactive Obstacle Avoidance with Deep Reinforcement Learning
    Bartomeu Rubí
    Bernardo Morcego
    Ramon Pérez
    Journal of Intelligent & Robotic Systems, 2021, 103
  • [44] Deep Reinforcement Learning for Mapless Robot Navigation Systems
    Oliveira, Iure Rosa L.
    Brandao, Alexandre S.
    2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, : 331 - 336
  • [45] Quantum Deep Reinforcement Learning for Robot Navigation Tasks
    Hohenfeld, Hans
    Heimann, Dirk
    Wiebe, Felix
    Kirchner, Frank
    IEEE ACCESS, 2024, 12 : 87217 - 87236
  • [46] Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation
    Changyun Wei
    Yajun Li
    Yongping Ouyang
    Ze Ji
    Journal of Intelligent & Robotic Systems, 2023, 109
  • [47] Growing Robot Navigation Based on Deep Reinforcement Learning
    Ataka, Ahmad
    Sandiwan, Andreas P.
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 115 - 120
  • [48] Deep Reinforcement Learning for Visual Semantic Navigation with Memory
    de Andrade Santos, Iury Batista
    Romero, Roseli A. F.
    2020 XVIII LATIN AMERICAN ROBOTICS SYMPOSIUM, 2020 XII BRAZILIAN SYMPOSIUM ON ROBOTICS AND 2020 XI WORKSHOP OF ROBOTICS IN EDUCATION (LARS-SBR-WRE 2020), 2020, : 114 - 119
  • [49] Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation
    Marchesini, Enrico
    Corsi, Davide
    Farinelli, Alessandro
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5590 - 5595
  • [50] Robotic navigation with deep reinforcement learning in transthoracic echocardiography
    Shida, Yuuki
    Kumagai, Souto
    Iwata, Hiroyasu
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2024, : 191 - 202