Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation

被引:0
|
作者
Estevez, Julian [1 ]
Manuel Lopez-Guede, Jose [2 ]
Del Valle-Echavarri, Javier [2 ]
Grana, Manuel [3 ]
机构
[1] University of the Basque Country (UPV/EHU), Group of Computational Intelligence, Faculty of Engineering of Gipuzkoa, Donostia-San Sebastian,20018, Spain
[2] Faculty of Engineering of Vitoria, UPV/EHU, Group of Computational Intelligence, Vitoria-Gasteiz,01006, Spain
[3] Faculty of Computer Science, UPV/EHU, Group of Computational Intelligence, Donostia-San Sebastian,20018, Spain
关键词
Freight transportation - Motion planning - Reinforcement learning - Robot programming - Unmanned aerial vehicles (UAV);
D O I
10.1109/ACCESS.2024.3470509
中图分类号
学科分类号
摘要
This study introduces a novel trajectory planning approach for the transportation of cable-suspended loads employing three quadrotors, relying on a reinforcement learning (RL) algorithm. The primary objective of this path planning method is to transport the cargo smoothly while avoiding its swing. Within this proposed solution, the value function of the RL is estimated through a feature vector and a parameter vector tailored to the specific problem. The parameter vector undergoes iterative updates via a batch method, subsequently guiding the generation of the desired trajectory through a greedy strategy. Ultimately, this desired trajectory is communicated to the quadrotor controller to ensure precise trajectory tracking. Simulation outcomes demonstrate the capability of the trained parameters to effectively fit the value function. © 2013 IEEE.
引用
收藏
页码:144009 / 144016
相关论文
共 50 条
  • [1] Trajectory planning of load transportation with multi-quadrotors based on reinforcement learning algorithm
    Li, Xiaoxuan
    Zhang, Jianlei
    Han, Jianda
    AEROSPACE SCIENCE AND TECHNOLOGY, 2021, 116
  • [2] Deep Reinforcement Learning Based Computation Offloading and Trajectory Planning for Multi-UAV Cooperative Target Search
    Luo, Quyuan
    Luan, Tom H.
    Shi, Weisong
    Fan, Pingzhi
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (02) : 504 - 520
  • [3] Multi-UAV Trajectory Design and Power Control Based on Deep Reinforcement Learning
    Zhang C.Y.
    Liang S.Y.
    He C.L.
    Wang K.Z.
    Journal of Communications and Information Networks, 2022, 7 (02): : 192 - 201
  • [4] Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning
    Zhao, Xiaoru
    Yang, Rennong
    Zhong, Liangsheng
    Hou, Zhiwei
    DRONES, 2024, 8 (01)
  • [5] Multi-Agent Deep Reinforcement Learning-Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing
    Wang, Liang
    Wang, Kezhi
    Pan, Cunhua
    Xu, Wei
    Aslam, Nauman
    Hanzo, Lajos
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) : 73 - 84
  • [6] Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking
    Moon, Jiseon
    Papaioannou, Savvas
    Laoudias, Christos
    Kolios, Panayiotis
    Kim, Sunwoo
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (20) : 15441 - 15455
  • [7] Bayesian Optimization Enhanced Deep Reinforcement Learning for Trajectory Planning and Network Formation in Multi-UAV Networks
    Gong, Shimin
    Wang, Meng
    Gu, Bo
    Zhang, Wenjie
    Dinh Thai Hoang
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (08) : 10933 - 10948
  • [8] Multi-UAV Mobile Edge Computing and Path Planning Platform Based on Reinforcement Learning
    Chang, Huan
    Chen, Yicheng
    Zhang, Baochang
    Doermann, David
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (03): : 489 - 498
  • [9] Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning
    Westheider, Jonas
    Rueckin, Julius
    Popovic, Marija
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 649 - 656
  • [10] Multi-UAV Adaptive Cooperative Formation Trajectory Planning Based on an Improved MATD3 Algorithm of Deep Reinforcement Learning
    Xing, Xiaojun
    Zhou, Zhiwei
    Li, Yan
    Xiao, Bing
    Xun, Yilin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (09) : 12484 - 12499