UAV 3D online track planning based on improved SAC algorithm

被引：4
|
作者：
Zhou, Yuxiang [1 ]
Shu, Jiansheng [1 ]
Hao, Hui [1 ]
Song, Huan [1 ]
Lai, Xiaochang [1 ]
机构：
[1] Xian Res Inst High Technol, Xian 710025, Peoples R China
来源：
JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING | 2024年 / 46卷 / 01期
关键词：
UAV; Online track planning; SAC algorithm; Self-attention; Artificial potential field; MOBILE AUTOMATON; PATH; MODEL;
D O I：
10.1007/s40430-023-04570-7
中图分类号：
TH [机械、仪表工业];
学科分类号：
0802 ;
摘要：
Online track planning technology is a key technology to improve the survivability and intelligence of UAVs. In this paper, a Soft Actor-Critic (SAC)-based online track planning algorithm is proposed by combining Artificial Potential Field (APF) algorithm and self-attentive mechanism. First, for the characteristics of high-dimensional complexity of environmental states presented in the 3D environmental space, the self-attention mechanism is introduced in the Actor network of SAC algorithm in order to analyze and process the state information. Secondly, the artificial potential field method is combined with the reward function of SAC algorithm to solve the problem of reward sparsity in online track planning. Finally, the observation, action, and reward functions of the algorithm are designed according to the characteristics of UAV online track planning. The experimental results show that the algorithm convergence speed and success rate of the improved SAC algorithm are significantly improved, which can realize the 3D online track planning of UAVs.
引用
收藏
页数：17
相关论文
共 50 条
  • [41] 2D and 3D path planning for mobile robots based on improved SSA algorithm
    Zhang, Mailing
    Hao, Pei
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2024,
  • [42] The UAV 3D route planning method based on the guide points
    Liu, Qiong-Xin
    Wang, Jing
    Gao, Chun-Xiao
    Song, Ye
    Gao, Chao
    Hao, Gui-Qing
    Li, Pei-Lun
    Zhu, Lei
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2014, 34 (11): : 1163 - 1168
  • [43] AUV 3D Path Planning Based On A* Algorithm
    Li, Mengchuan
    Zhang, Huajun
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 11 - 16
  • [44] UAV path planning and collision avoidance in 3D environments based on POMPD and improved grey wolf optimizer
    Jiang, Wei
    Lyu, Yongxi
    Li, Yongfeng
    Guo, Yicong
    Zhang, Weiguo
    [J]. AEROSPACE SCIENCE AND TECHNOLOGY, 2022, 121
  • [45] UAV Path Planning Based on an Improved Chimp Optimization Algorithm
    Chen, Qinglong
    He, Qing
    Zhang, Damin
    [J]. AXIOMS, 2023, 12 (07)
  • [46] A method of UAV path planning based on an improved RRT algorithm
    Li, Yue
    Han, Wei
    Zhang, Yong
    Mu, Wanhui
    [J]. 2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [47] Route Planning of UAV Based on Improved Ant Colony Algorithm
    Qian, Zhengxiang
    Wang, Guocheng
    Wang, Jingen
    Shi, Yongxin
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON LOGISTICS, ENGINEERING, MANAGEMENT AND COMPUTER SCIENCE (LEMCS 2015), 2015, 117 : 1421 - 1426
  • [48] UAV Path Planning Based on an Improved Ant Colony Algorithm
    Huan, Liu
    Ning, Zhang
    Qiang, Li
    [J]. 2021 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2021), 2021, : 357 - 360
  • [49] Research on Path Planning in 3D Complex Environments Based on Improved Ant Colony Algorithm
    Zhou, Hang
    Jiang, Ziqi
    Xue, Yuting
    Li, Weicong
    Cai, Fanger
    Li, Yunchen
    [J]. SYMMETRY-BASEL, 2022, 14 (09):
  • [50] An Anti-Disturbance Resilience Enhanced Algorithm for UAV 3D Route Planning
    Xu, Zhining
    Zhang, Long
    Ma, Xiaoshan
    Liu, Yang
    Yang, Lin
    Yang, Feng
    [J]. SENSORS, 2022, 22 (06)
12345