Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning

被引:0
|
作者
Bo, Lan [1 ]
Zhang, Tiezhu [1 ]
Zhang, Hongxin [1 ]
Yang, Jian [1 ,2 ]
Zhang, Zhen [1 ]
Zhang, Caihong [3 ]
Liu, Mingjie [1 ]
机构
[1] Qingdao Univ, Coll Mech & Elect Engn, Qingdao 266071, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Mech Engn, Beijing 100083, Peoples R China
[3] Qingdao Univ, Sch Automat, Qingdao 266071, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Path planning; Q-learning; Flowering plants; Collision avoidance; Heuristic algorithms; Autonomous aerial vehicles; Convergence; unmanned aerial vehicle; obstacle avoidance; reinforcement learning; flower pollination algorithm; COLLISION-AVOIDANCE; NEURAL-NETWORKS; UAV;
D O I
10.1109/ACCESS.2024.3434621
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Planning a path is crucial for safe and efficient Unmanned aerial vehicle flights, especially in complex environments. While the Q-learning algorithm in reinforcement learning performs better in handling such environments, it suffers from slow convergence speed and limited real-time capability. To address these problems, this study proposes an enhanced initialization process using the flower pollination algorithm and employs a tabulation method to improve local obstacle avoidance ability. An improved Q-learning algorithm based on the flower pollination algorithm and tabulation method (IQ-FAT) is proposed, which can perform both global and local path planning, enhance the convergence time of Q-learning, and expedite obstacle avoidance. Evaluation results on various obstacle maps demonstrate that the modified algorithm has a significant improvement convergence speed of approximately 40% compared to the original algorithm while enabling global path planning and local obstacle avoidance. Furthermore, the algorithm demonstrates superior path-planning capabilities in complex environments and enhances the dynamic response time of UAVs by approximately 90% compared to the artificial potential field method.
引用
收藏
页码:104429 / 104444
页数:16
相关论文
共 50 条
  • [1] Path planning for unmanned surface vehicle based on improved Q-Learning algorithm
    Wang, Yuanhui
    Lu, Changzhou
    Wu, Peng
    Zhang, Xiaoyue
    [J]. OCEAN ENGINEERING, 2024, 292
  • [2] Neighborhood global learning based flower pollination algorithm and its application to unmanned aerial vehicle path planning
    Chen, Yang
    Pi, Dechang
    Xu, Yue
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 170
  • [3] Simulation for Path Planning of Autonomous Underwater Vehicle Using Flower Pollination Algorithm, Genetic Algorithm and Q-Learning
    Gautam, Utkarsh
    Malmathanraj, R.
    Srivastav, Chhavi
    [J]. 2015 INTERNATIONAL CONFERENCE ON COGNITIVE COMPUTING AND INFORMATION PROCESSING (CCIP), 2015,
  • [4] An Improved Flower Pollination Algorithm for Optimal Unmanned Undersea Vehicle Path Planning Problem
    Zhou, Yongquan
    Wang, Rui
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2016, 30 (04)
  • [5] A path planning method for unmanned aerial vehicle based on improved wolf pack algorithm
    Jiang, Hao
    Yu, Qizhou
    Han, Dan
    Chen, Yaqing
    Li, Zejun
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (14):
  • [6] A Path Planning Algorithm for UAV Based on Improved Q-Learning
    Yan, Chao
    Xiang, Xiaojia
    [J]. 2018 2ND INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS), 2018, : 46 - 50
  • [7] An immune plasma algorithm with Q-learning based pandemic management for path planning of unmanned aerial vehicles
    Aslan, Selcuk
    Demirci, Sercan
    [J]. EGYPTIAN INFORMATICS JOURNAL, 2024, 26
  • [8] Path planning of unmanned aerial vehicle based on improved gravitational search algorithm
    LI Pei DUAN HaiBin Science and Technology on Aircraft Control LaboratorySchool of Automation Science and Electrical EngineeringBeihang UniversityBeijing China State Key Laboratory of Virtual Reality Technology and SystemsBeihang UniversityBeijing China
    [J]. Science China(Technological Sciences)., 2012, 55 (10) - 2719
  • [9] A Study on Path Planning of Unmanned Aerial Vehicle Based on Improved Genetic Algorithm
    Tao, Jihua
    Zhong, Chaoliang
    Gao, Li
    Deng, Hao
    [J]. 2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 2, 2016, : 392 - 395
  • [10] Path planning of unmanned aerial vehicle based on improved gravitational search algorithm
    Li Pei
    Duan HaiBin
    [J]. SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2012, 55 (10) : 2712 - 2719