Reinforcement Learning for Altitude Hold and Path Planning in a Quadcopter

被引:0
|
作者
Karthik, P. B. [1 ]
Kumar, Keshav [2 ]
Fernandes, Vikrant [3 ]
Arya, Kavi [3 ]
机构
[1] PES Univ, Dept Elect & Commun, Bengaluru, India
[2] KIET Grp Inst, Dept Elect & Commun, Ghaziabad, India
[3] Indian Inst Technol, eYantra, Mumbai, Maharashtra, India
关键词
reinforcement learning; Q-learning; ROS; PID; real world simulation; V-REP; path planning; navigation; localization; whycon; nano drone;
D O I
10.1109/iccar49639.2020.9108104
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The control and stability of drones is a challenging problem. There is need for a more dynamic and robust control that the drone can use to adjust itself to an unknown environment directly. This paper presents a framework for using reinforcement learning to control altitude of a drone. We use PID to stabilize x and y axis of the drone. The drone is trained using Q-learning of Reinforcement Learning in a simulated environment. The trained model is then tested in the real world. Furthermore, a comparative analysis of reinforcement learning and PID algorithm is presented. Finally, an application of way-point navigation from one given point to other in an environment filled with obstacles at different points formulated as a 3-dimensional grid is presented using Q-learning of Reinforcement Learning.
引用
收藏
页码:463 / 467
页数:5
相关论文
共 50 条
  • [1] Sensor Path Planning Using Reinforcement Learning
    Hoffmann, Folker
    Charlish, Alexander
    Ritchie, Matthew
    Griffiths, Hugh
    PROCEEDINGS OF 2020 23RD INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2020), 2020, : 420 - 427
  • [2] Reinforcement Learning Applied to Agent Path Planning
    Sun, Fenglan
    Wu, Xiaoshuai
    Long, Guoxiong
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3639 - 3644
  • [3] Path Planning of Cleaning Robot with Reinforcement Learning
    Moon, Woohyeon
    Park, Bumgeun
    Nengroo, Sarvar Hussain
    Kim, Taeyoung
    Har, Dongsoo
    2022 IEEE INTERNATIONAL SYMPOSIUM ON ROBOTIC AND SENSORS ENVIRONMENTS (ROSE), 2022,
  • [4] Geometric Reinforcement Learning for Path Planning of UAVs
    Baochang Zhang
    Zhili Mao
    Wanquan Liu
    Jianzhuang Liu
    Journal of Intelligent & Robotic Systems, 2015, 77 : 391 - 409
  • [5] Geometric Reinforcement Learning for Path Planning of UAVs
    Zhang, Baochang
    Mao, Zhili
    Liu, Wanquan
    Liu, Jianzhuang
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2015, 77 (02) : 391 - 409
  • [6] Planning Swift Maneuvers of Quadcopter Using Motion Primitives Explored by Reinforcement Learning
    Camci, Efe
    Kayacan, Erdal
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 279 - 285
  • [7] Metaheuristic Optimization-Based Path Planning and Tracking of Quadcopter for Payload Hold-Release Mission
    Belge, Egemen
    Altan, Aytac
    Hacioglu, Rifat
    ELECTRONICS, 2022, 11 (08)
  • [8] Reinforcement Learning-Based Low-Altitude Path Planning for UAS Swarm in Diverse Threat Environments
    Hu, Jinwen
    Fan, Liyuan
    Lei, Yifei
    Xu, Zhao
    Fu, Wenxing
    Xu, Gang
    DRONES, 2023, 7 (09)
  • [9] Efficient Deep Reinforcement Learning for Optimal Path Planning
    Ren, Jing
    Huang, Xishi
    Huang, Raymond N.
    ELECTRONICS, 2022, 11 (21)
  • [10] Path planning of autonomous UAVs using reinforcement learning
    Chronis, Christos
    Anagnostopoulos, Georgios
    Politi, Elena
    Garyfallou, Antonios
    Varlamis, Iraklis
    Dimitrakopoulos, George
    12TH EASN INTERNATIONAL CONFERENCE ON "INNOVATION IN AVIATION & SPACE FOR OPENING NEW HORIZONS", 2023, 2526