Cooperative Landing on Mobile Platform for Multiple Unmanned Aerial Vehicles via Reinforcement Learning

被引:1
|
作者
Xu, Yahao [1 ]
Li, Jingtai [2 ]
Wu, Bi [3 ]
Wu, Junqi [1 ]
Deng, Hongbin [1 ]
Hui, David [4 ]
机构
[1] Beijing Inst Technol, Sch Mechatron Engn, Beijing 100081, Peoples R China
[2] Minist Ind & Informat Technol, Equipment Ind Dev Ctr, Beijing 100804, Peoples R China
[3] Beijing Blue Sky Innovat Ctr Frontier Sci, Lab 1, Beijing 100085, Peoples R China
[4] Univ New Orleans, Dept Mech Engn, Composite Mat Res Lab, New Orleans, LA 70148 USA
基金
中国国家自然科学基金;
关键词
PIGEON-INSPIRED OPTIMIZATION; UAV; VERSATILE;
D O I
10.1061/JAEEEZ.ASENG-5053
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper proposes a multiple unmanned aerial vehicles (UAVs) cooperative landing algorithm based on deep reinforcement learning. First, to solve the partial observation problem, we propose the recurrent neural network to predict the moving platform trajectory. Afterwards, with the centralized multiagent framework, we present a parameter sharing method to realize multi-UAV cooperation. Finally, focusing on the sensor noise problem of the actual UAV flight, we propose a noise compensation recurrent proximal policy optimization (NC-RPPO) algorithm to extract images' features to compensate for inertial measurement unit (IMU) and GPS errors. We utilize AirSim to construct a simulated 3D environment resembling an offshore oil development zone. In this setting, we evaluate the effectiveness of our proposed multi-UAV cooperative landing algorithm while considering the presence of sensor noise. Through experimental trials, we demonstrate that our NC-RPPO algorithm enables UAVs to accurately predict the trajectory of a mobile platform and successfully land on it cooperatively in real time. Notably, the experimental outcomes obtained through our image-assisted noise correction method closely align with those obtained from the ground truth experiment.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Cooperative Manipulation of an Unknown Object via Omnidirectional Unmanned Aerial Vehicles
    Francesco Pierri
    Michelangelo Nigro
    Giuseppe Muscio
    Fabrizio Caccavale
    Journal of Intelligent & Robotic Systems, 2020, 100 : 1635 - 1649
  • [32] Parallel Distributional Prioritized Deep Reinforcement Learning for Unmanned Aerial Vehicles
    Kolling, Alisson Henrique
    Kich, Victor Augusto
    de Jesus, Junior Costa
    da Silva, Andressa Cavalcante
    Grando, Ricardo Bedin
    Jorge Drews-, Paulo Lilles, Jr.
    Gamarra, Daniel F. T.
    2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, : 95 - 100
  • [33] Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles
    Jembre, Yalew Zelalem
    Nugroho, Yuniarto Wimbo
    Khan, Muhammad Toaha Raza
    Attique, Muhammad
    Paul, Rajib
    Shah, Syed Hassan Ahmed
    Kim, Beomjoon
    APPLIED SCIENCES-BASEL, 2021, 11 (16):
  • [34] Autonomous Landing of Micro Unmanned Aerial Vehicles with Landing-Assistive Platform and Robust Spherical Object Detection
    Lee, Donghee
    Park, Wooryong
    Nam, Woochul
    APPLIED SCIENCES-BASEL, 2021, 11 (18):
  • [35] Automated Enemy Avoidance of Unmanned Aerial Vehicles Based on Reinforcement Learning
    Cheng, Qiao
    Wang, Xiangke
    Yang, Jian
    Shen, Lincheng
    APPLIED SCIENCES-BASEL, 2019, 9 (04):
  • [36] Controlling Tiltrotors Unmanned Aerial Vehicles (UAVs) with Deep Reinforcement Learning
    de Almeida, Aline Gabriel
    Colombini, Esther Luna
    Simoes, Alexandre da Silva
    2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, : 107 - 112
  • [37] Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning
    Lu, Huimin
    Li, Yujie
    Mu, Shenglin
    Wang, Dong
    Kim, Hyoungseop
    Serikawa, Seiichi
    IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (04): : 2315 - 2322
  • [38] Robust planning the landing process of unmanned aerial vehicles
    Nguyen Dinh Dung
    Rohacs, Jozsef
    INTERNATIONAL JOURNAL OF SUSTAINABLE AVIATION, 2019, 5 (01) : 1 - 18
  • [39] Simulation system for autonomous landing of unmanned aerial vehicles
    Chen, L
    Chen, ZJ
    SYSTEM SIMULATION AND SCIENTIFIC COMPUTING, VOLS 1 AND 2, PROCEEDINGS, 2005, : 499 - 503
  • [40] Energy optimization algorithm for ISAC-enabled unmanned aerial vehicles system via reinforcement learning
    Li, Xinmin
    Zhang, Xuhao
    Liu, Yiyang
    Cao, Hui
    Zhang, Xiaoqiang
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2025, 54 (01): : 23 - 28