Path planning of UAV using guided enhancement Q-learning algorithm

被引:0
|
作者
Zhou, Bin [1 ]
Guo, Yan [1 ]
Li, Ning [1 ]
Zhong, Xijian [1 ]
机构
[1] College of Communications Engineering, Army Engineering University of PLA, Nanjing,210007, China
基金
中国国家自然科学基金;
关键词
Reinforcement learning - Antennas - Learning algorithms - Energy utilization - Unmanned aerial vehicles (UAV);
D O I
10.7527/S1000-6893.2021.25109
中图分类号
学科分类号
摘要
With the increasing application of the Unmanned Aerial Vehicle (UAV) technology, the energy consumption and computing capacity of UAV are faced with bottleneck problems, so path planning of UAV is becoming increasingly important. In many cases, the UAV cannot obtain the exact location of the target point and environmental information in advance, and thus is difficult to plan an effective flight path. To solve this problem, this paper proposes a path planning method for UAV using the guided enhancement Q-learning algorithm. This method uses Receiving Signal Strength (RSS) to define the reward value, and continuously optimizes the path by using the Q-learning algorithm. The principle of guided reinforcement is proposed to accelerate the convergence speed of the Q learning algorithm. The simulation results show that the method proposed can realize autonomous navigation and fast path planning for UAV. Compared with the traditional algorithm, it can greatly reduce the number of iterations and obtain a shorter planned path. © 2021, Beihang University Aerospace Knowledge Press. All right reserved.
引用
收藏
相关论文
共 50 条
  • [1] A Path Planning Algorithm for UAV Based on Improved Q-Learning
    Yan, Chao
    Xiang, Xiaojia
    [J]. 2018 2ND INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS), 2018, : 46 - 50
  • [2] Hybrid Path Planning of A Quadrotor UAV Based on Q-Learning Algorithm
    Zhang, Tianze
    Huo, Xin
    Chen, Songlin
    Yang, Baoqing
    Zhang, Guojiang
    [J]. 2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 5415 - 5419
  • [3] UAV path planning algorithm based on Deep Q-Learning to search for a lost in the ocean
    Boulares, Mehrez
    Fehri, Afef
    Jemni, Mohamed
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2024, 179
  • [4] Q-learning Guided Grey Wolf Optimizer for UAV 3D Path Planning
    Tu, Binbin
    Wang, Fei
    Han, Xiaowei
    Fu, Xibei
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (07) : 469 - 478
  • [5] UAV Path Planning Optimization Strategy: Considerations of Urban Morphology, Microclimate, and Energy Efficiency Using Q-Learning Algorithm
    Souto, Anderson
    Alfaia, Rodrigo
    Cardoso, Evelin
    Araujo, Jasmine
    Frances, Carlos
    [J]. DRONES, 2023, 7 (02)
  • [6] ETQ-learning: an improved Q-learning algorithm for path planning
    Wang, Huanwei
    Jing, Jing
    Wang, Qianlv
    He, Hongqi
    Qi, Xuyan
    Lou, Rui
    [J]. INTELLIGENT SERVICE ROBOTICS, 2024, 17 (04) : 915 - 929
  • [7] A Modified Q-learning Multi Robot Path Planning Algorithm
    Li, Bo
    Liang, Hongbin
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 127 : 125 - 126
  • [8] A 3D Q-Learning Algorithm for Offline UAV Path Planning with Priority Shifting Rewards
    de Carvalho, Kevin Braathen
    Batista, Hiago B.
    de Oliveira, Iure L.
    Brandao, Alexandre S.
    [J]. 2022 LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS), 2022 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR), AND 2022 WORKSHOP ON ROBOTICS IN EDUCATION (WRE), 2022, : 169 - 174
  • [9] An Adaptive Conversion Speed Q-Learning Algorithm for Search and Rescue UAV Path Planning in Unknown Environments
    Wu, Jiehong
    Sun, Ya'nan
    Li, Danyang
    Shi, Junling
    Li, Xianwei
    Gao, Lijun
    Yu, Lei
    Han, Guangjie
    Wu, Jinsong
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 15391 - 15404
  • [10] Mobile robot path planning based on Q-learning algorithm
    Li, Shaochuan
    Wang, Xuiqing
    Hu, Liwei
    Liu, Ying
    [J]. 2019 WORLD ROBOT CONFERENCE SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA 2019), 2019, : 160 - 165