Reinforcement learning-based multi-strategy cuckoo search algorithm for 3D UAV path planning

被引:26
|
作者
Yu, Xiaobing [1 ]
Luo, Wenguan
机构
[1] Nanjing Univ Informat Sci & Technol, Res Ctr Risk Management & Emergency Decis Making, Sch Management Sci & Engn, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Path planning; Constrained optimization problem; Reinforcement learning; Cuckoo search algorithm; DIFFERENTIAL EVOLUTION;
D O I
10.1016/j.eswa.2023.119910
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned aerial vehicles are applied extensively in various fields due to their advantages of low-cost, high -maneuverability, and easy-operation. However, the path planning problem of unmanned aerial vehicles, which directly determines the flight safety and efficiency, still remains challenging when building and optimizing the path model. To further study the path planning problem, we firstly construct it as a constrained optimization problem. The objective function considers the costs of path length and threat, and the constraints involve the collision and turning angle. Additionally, we employ the theory of B-Spline curve to represent the planned paths to facilitate the optimization of established model. Then, aiming at the poor searchability and slow convergence speed of current optimization methods, we propose a reinforcement learning-based multi-strategy cuckoo search algorithm. Specifically, we establish an innovative reinforcement learning-based multi-strategy mechanism and a reinforced switch parameter based on the theory of reinforcement learning. To verify the effectiveness of the proposed algorithm, extensive experiments are carried out on the CEC'17 benchmark test and different three-dimensional path planning problems. Detailed statistical analysis of the experimental results confirm the supe-riority of our proposed algorithm to the other well-established algorithms.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Improved Dung Beetle Optimizer Algorithm With Multi-Strategy for Global Optimization and UAV 3D Path Planning
    Lyu, Lixin
    Jiang, Hong
    Yang, Fan
    [J]. IEEE ACCESS, 2024, 12 : 69240 - 69257
  • [2] Multi-Strategy Adaptive Cuckoo Search Algorithm
    Gao, Shuzhi
    Gao, Yue
    Zhang, Yimin
    Xu, Lintao
    [J]. IEEE ACCESS, 2019, 7 : 137642 - 137655
  • [3] Optimizing 3D UAV Path Planning: A Multi-strategy Enhanced Beluga Whale Optimizer
    Ye, Chen
    Wang, Wentao
    Zhang, Shaoping
    Shao, Peng
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2023, PT II, 2024, 14448 : 42 - 54
  • [4] UAV Path Planning and Obstacle Avoidance Based on Reinforcement Learning in 3D Environments
    Tu, Guan-Ting
    Juang, Jih-Gau
    [J]. ACTUATORS, 2023, 12 (02)
  • [5] A Multi-Strategy Collaborative Grey Wolf Optimization Algorithm for UAV Path Planning
    Rao, Chaoyi
    Wang, Zilong
    Shao, Peng
    [J]. ELECTRONICS, 2024, 13 (13)
  • [6] Research on UAV Path Planning Based on an Improved Dwarf Mongoose Algorithm with Multi-strategy Fusion
    Wang, Haocheng
    Zhang, Yu
    Xu, Sitong
    Wang, Fangchao
    Chen, Baolong
    [J]. ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT I, ICIC 2024, 2024, 14862 : 348 - 359
  • [7] Improved Artificial Bee Colony Algorithm Based on Multi-Strategy Synthesis for UAV Path Planning
    Lin, Siqi
    Li, Feifei
    Li, Xuyang
    Jia, Kejin
    Zhang, Xiaowei
    [J]. IEEE ACCESS, 2022, 10 : 119269 - 119282
  • [8] Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV
    Liu, Xiang
    Zhong, Weizhi
    Wang, Xin
    Duan, Hongtao
    Fan, Zhenxiong
    Jin, Haowen
    Huang, Yang
    Lin, Zhipeng
    [J]. DRONES, 2024, 8 (05)
  • [9] Multi-UAV Search and Rescue with Enhanced A* Algorithm Path Planning in 3D Environment
    Du, Yuwen
    [J]. INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2023, 2023
  • [10] Application of uniform experimental design theory to multi-strategy improved sparrow search algorithm for UAV path planning
    Cheng, Lianyu
    Ling, Guang
    Liu, Feng
    Ge, Ming-Feng
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255