Energy Efficient Path Planning Scheme for Unmanned Aerial Vehicle Using Hybrid Generic Algorithm-Based Q-Learning Optimization

被引:3
|
作者
Saeed, Rashid A. [1 ]
Ali, Elmustafa Sayed [2 ]
Abdelhaq, Maha [3 ]
Alsaqour, Raed [4 ]
Ahmed, Fatima Rayan Awad [5 ]
Saad, Asma Mohammed Elbashir [6 ]
机构
[1] Taif Univ, Coll Comp & Informat Technol, Dept Comp Engn, Taif 21944, Saudi Arabia
[2] Sudan Univ Sci & Technol SUST, Coll Engn, Dept Elect Engn, Khartoum 11111, Sudan
[3] Princess Nourah bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Informat Technol, POB 84428, Riyadh 11671, Saudi Arabia
[4] Saudi Elect Univ, Coll Comp & Informat, Dept Informat Technol, Riyadh 11673, Saudi Arabia
[5] Prince Sattam bin Abdulaziz Univ, Comp Sci Dept, Riyadh 65131, Saudi Arabia
[6] Prince Sattam Bin Abdulaziz Univ, Coll Sci & Humanities, Dept Phys, Al Kharj 16273, Saudi Arabia
关键词
AI; energy efficiency; path planning; unmanned aerial vehicles; energy optimization; hybrid genetic algorithm; obstacle avoidance; GA; UAVS; MODEL;
D O I
10.1109/ACCESS.2023.3344455
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Efficient path planning optimization strategies are required to maximize flying time while consuming the least energy. This research offers a novel approach for energy-efficient path planning for Unmanned Aerial Vehicles (UAVs) that combines a hybrid evolutionary algorithm and Q-learning while accounting for the UAV's velocity and distance from obstacles. To overcome the constraints of traditional optimization approaches, the hybrid methodology combines genetic algorithms and Q-learning. The suggested approach optimizes path-planning decisions based on real-time information by considering the UAV's velocity and distance from obstacles. Genetic Algorithm (GA) creates a wide collection of candidate pathways. In contrast, Q-learning uses reinforcement learning to make educated selections based on the UAV's present velocity and proximity to static obstacles. This integration allows the UAV to modify its path dynamically based on its energy requirements and environmental constraints. The main goal is to develop a UAV path planning scheme capable of dealing with obstacle-filled environments to improve energy efficiency and collision avoidance during flight missions. Our experimental results show that the hybrid technique outperforms the classical GA method in terms of energy efficiency by significantly reducing energy consumption while maintaining a suitable collision rate and the best path cost to the desired locations. The analysis results improve the performance of the hybrid GA/QL algorithm by more than 57.14% compared to classical GA.
引用
收藏
页码:13400 / 13417
页数:18
相关论文
共 50 条
  • [1] Quality-Oriented Hybrid Path Planning Based on A* and Q-Learning for Unmanned Aerial Vehicle
    Li, Dongcheng
    Yin, Wangping
    Wong, W. Eric
    Jian, Mingyong
    Chau, Matthew
    [J]. IEEE ACCESS, 2022, 10 : 7664 - 7674
  • [2] Path planning for unmanned surface vehicle based on improved Q-Learning algorithm
    Wang, Yuanhui
    Lu, Changzhou
    Wu, Peng
    Zhang, Xiaoyue
    [J]. OCEAN ENGINEERING, 2024, 292
  • [3] Improved Q-Learning Algorithm Based on Flower Pollination Algorithm and Tabulation Method for Unmanned Aerial Vehicle Path Planning
    Bo, Lan
    Zhang, Tiezhu
    Zhang, Hongxin
    Yang, Jian
    Zhang, Zhen
    Zhang, Caihong
    Liu, Mingjie
    [J]. IEEE ACCESS, 2024, 12 : 104429 - 104444
  • [4] An immune plasma algorithm with Q-learning based pandemic management for path planning of unmanned aerial vehicles
    Aslan, Selcuk
    Demirci, Sercan
    [J]. EGYPTIAN INFORMATICS JOURNAL, 2024, 26
  • [5] Heuristic Q-learning based on experience replay for three-dimensional path planning of the unmanned aerial vehicle
    Xie, Ronglei
    Meng, Zhijun
    Zhou, Yaoming
    Ma, Yunpeng
    Wu, Zhe
    [J]. SCIENCE PROGRESS, 2020, 103 (01)
  • [6] Coverage Path Planning Optimization Based on Q-Learning Algorithm
    Piardi, Luis
    Lima, Jose
    Pereira, Ana, I
    Costa, Paulo
    [J]. INTERNATIONAL CONFERENCE ON NUMERICAL ANALYSIS AND APPLIED MATHEMATICS (ICNAAM-2018), 2019, 2116
  • [7] Hybrid Path Planning Algorithm of the Mobile Agent Based on Q-Learning
    Gao, Tengteng
    Li, Caihong
    Liu, Guoming
    Guo, Na
    Wang, Di
    Li, Yongdi
    [J]. AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2022, 56 (02) : 130 - 142
  • [8] Hybrid Path Planning of A Quadrotor UAV Based on Q-Learning Algorithm
    Zhang, Tianze
    Huo, Xin
    Chen, Songlin
    Yang, Baoqing
    Zhang, Guojiang
    [J]. 2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 5415 - 5419
  • [9] Hybrid Path Planning Algorithm of the Mobile Agent Based on Q-Learning
    Caihong Tengteng Gao
    Guoming Li
    Na Liu
    Di Guo
    Yongdi Wang
    [J]. Automatic Control and Computer Sciences, 2022, 56 : 130 - 142
  • [10] Indoor Emergency Path Planning Based on the Q-Learning Optimization Algorithm
    Xu, Shenghua
    Gu, Yang
    Li, Xiaoyan
    Chen, Cai
    Hu, Yingyi
    Sang, Yu
    Jiang, Wenxing
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (01)