Reinforcement Learning for Altitude Hold and Path Planning in a Quadcopter

被引:0
|
作者
Karthik, P. B. [1 ]
Kumar, Keshav [2 ]
Fernandes, Vikrant [3 ]
Arya, Kavi [3 ]
机构
[1] PES Univ, Dept Elect & Commun, Bengaluru, India
[2] KIET Grp Inst, Dept Elect & Commun, Ghaziabad, India
[3] Indian Inst Technol, eYantra, Mumbai, Maharashtra, India
关键词
reinforcement learning; Q-learning; ROS; PID; real world simulation; V-REP; path planning; navigation; localization; whycon; nano drone;
D O I
10.1109/iccar49639.2020.9108104
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The control and stability of drones is a challenging problem. There is need for a more dynamic and robust control that the drone can use to adjust itself to an unknown environment directly. This paper presents a framework for using reinforcement learning to control altitude of a drone. We use PID to stabilize x and y axis of the drone. The drone is trained using Q-learning of Reinforcement Learning in a simulated environment. The trained model is then tested in the real world. Furthermore, a comparative analysis of reinforcement learning and PID algorithm is presented. Finally, an application of way-point navigation from one given point to other in an environment filled with obstacles at different points formulated as a 3-dimensional grid is presented using Q-learning of Reinforcement Learning.
引用
收藏
页码:463 / 467
页数:5
相关论文
共 50 条
  • [41] UAV swarm path planning with reinforcement learning for field prospecting
    Alejandro Puente-Castro
    Daniel Rivero
    Alejandro Pazos
    Enrique Fernandez-Blanco
    Applied Intelligence, 2022, 52 : 14101 - 14118
  • [42] A UAV Path Planning Method Based on Deep Reinforcement Learning
    Li, Yibing
    Zhang, Sitong
    Ye, Fang
    Jiang, Tao
    Li, Yingsong
    2020 IEEE USNC-CNC-URSI NORTH AMERICAN RADIO SCIENCE MEETING (JOINT WITH AP-S SYMPOSIUM), 2020, : 93 - 94
  • [43] Deep Reinforcement Learning for Indoor Mobile Robot Path Planning
    Gao, Junli
    Ye, Weijie
    Guo, Jing
    Li, Zhongjuan
    SENSORS, 2020, 20 (19) : 1 - 15
  • [44] Navigating Assistance System for Quadcopter with Deep Reinforcement Learning
    Wu, Tung-Cheng
    Tseng, Shau-Yin
    Lai, Chin-Feng
    Ho, Chia-Yu
    Lai, Ying-Hsun
    2018 FIRST INTERNATIONAL COGNITIVE CITIES CONFERENCE (IC3 2018), 2018, : 16 - 19
  • [45] A spatially wind aware quadcopter (UAV) path planning approach
    Thanellas, Georgios A.
    Moulianitis, Vassilis C.
    Aspragathos, Nikos A.
    IFAC PAPERSONLINE, 2019, 52 (08): : 283 - 288
  • [46] Selecting Subgoal for Social AGV Path Planning by Using Reinforcement Learning
    Wu, Cheng-En
    Tsai, Hsiao-Ping
    Proceedings - IEEE International Conference on Mobile Data Management, 2022, 2022-June : 452 - 457
  • [47] Multi-Robot Path Planning Method Using Reinforcement Learning
    Bae, Hyansu
    Kim, Gidong
    Kim, Jonguk
    Qian, Dianwei
    Lee, Sukgyu
    APPLIED SCIENCES-BASEL, 2019, 9 (15):
  • [48] Research on Path Planning Strategy of Rescue Robot Based on Reinforcement Learning
    Shi, Ying-Ming
    Zhang, Zhiyuan
    Journal of Computers (Taiwan), 2022, 33 (03) : 187 - 194
  • [49] Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning
    Tang, Jin
    Liang, Yangang
    Li, Kebo
    DRONES, 2024, 8 (02)
  • [50] Improved Robot Path Planning Method Based on Deep Reinforcement Learning
    Han, Huiyan
    Wang, Jiaqi
    Kuang, Liqun
    Han, Xie
    Xue, Hongxin
    SENSORS, 2023, 23 (12)