Reinforcement Learning for Altitude Hold and Path Planning in a Quadcopter

被引:0
|
作者
Karthik, P. B. [1 ]
Kumar, Keshav [2 ]
Fernandes, Vikrant [3 ]
Arya, Kavi [3 ]
机构
[1] PES Univ, Dept Elect & Commun, Bengaluru, India
[2] KIET Grp Inst, Dept Elect & Commun, Ghaziabad, India
[3] Indian Inst Technol, eYantra, Mumbai, Maharashtra, India
关键词
reinforcement learning; Q-learning; ROS; PID; real world simulation; V-REP; path planning; navigation; localization; whycon; nano drone;
D O I
10.1109/iccar49639.2020.9108104
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The control and stability of drones is a challenging problem. There is need for a more dynamic and robust control that the drone can use to adjust itself to an unknown environment directly. This paper presents a framework for using reinforcement learning to control altitude of a drone. We use PID to stabilize x and y axis of the drone. The drone is trained using Q-learning of Reinforcement Learning in a simulated environment. The trained model is then tested in the real world. Furthermore, a comparative analysis of reinforcement learning and PID algorithm is presented. Finally, an application of way-point navigation from one given point to other in an environment filled with obstacles at different points formulated as a 3-dimensional grid is presented using Q-learning of Reinforcement Learning.
引用
收藏
页码:463 / 467
页数:5
相关论文
共 50 条
  • [21] Path planning of virtual human by using reinforcement learning
    He, Yue-Sheng
    Tang, Yuan-Yan
    PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2008, : 987 - 992
  • [22] Robust Deep Reinforcement Learning for Quadcopter Control
    Deshpande, Aditya M.
    Minai, Ali A.
    Kumar, Manish
    IFAC PAPERSONLINE, 2021, 54 (20): : 90 - 95
  • [23] Deep reinforcement learning for indoor mobile robot path planning
    Gao, Junli
    Ye, Weijie
    Guo, Jing
    Li, Zhongjuan
    Sensors (Switzerland), 2020, 20 (19): : 1 - 15
  • [24] UAV swarm path planning with reinforcement learning for field prospecting
    Puente-Castro, Alejandro
    Rivero, Daniel
    Pazos, Alejandro
    Fernandez-Blanco, Enrique
    APPLIED INTELLIGENCE, 2022, 52 (12) : 14101 - 14118
  • [25] A Reinforcement Learning-based Path Planning for Collaborative UAVs
    Rahim, Shahnila
    Razaq, Mian Muaz
    Chang, Shih Yu
    Peng, Limei
    37TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, 2022, : 1938 - 1943
  • [26] Explainable Deep Reinforcement Learning for UAV autonomous path planning
    He, Lei
    Aouf, Nabil
    Song, Bifeng
    AEROSPACE SCIENCE AND TECHNOLOGY, 2021, 118
  • [27] UCAV Path Planning Algorithm Based on Deep Reinforcement Learning
    Zheng, Kaiyuan
    Gao, Jingpeng
    Shen, Liangxi
    IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 : 702 - 714
  • [28] Intelligent Path Planning of Underwater Robot Based on Reinforcement Learning
    Yang, Jiachen
    Ni, Jingfei
    Xi, Meng
    Wen, Jiabao
    Li, Yang
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, 20 (03) : 1983 - 1996
  • [29] Research on path planning of robot based on deep reinforcement learning
    Liu, Feng
    Chen, Chang
    Li, Zhihua
    Guan, Zhi-Hong
    Wang, Hua O.
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3730 - 3734
  • [30] Robot path planning in dynamic environment based on reinforcement learning
    Zhuang, Xiao-Dong
    Meng, Qing-Chun
    Wei, Tian-Bin
    Wang, Xu-Zhu
    Tan, Rui
    Li, Xiao-Jing
    Journal of Harbin Institute of Technology (New Series), 2001, 8 (03) : 253 - 255