Cooperative Landing on Mobile Platform for Multiple Unmanned Aerial Vehicles via Reinforcement Learning

被引:1
|
作者
Xu, Yahao [1 ]
Li, Jingtai [2 ]
Wu, Bi [3 ]
Wu, Junqi [1 ]
Deng, Hongbin [1 ]
Hui, David [4 ]
机构
[1] Beijing Inst Technol, Sch Mechatron Engn, Beijing 100081, Peoples R China
[2] Minist Ind & Informat Technol, Equipment Ind Dev Ctr, Beijing 100804, Peoples R China
[3] Beijing Blue Sky Innovat Ctr Frontier Sci, Lab 1, Beijing 100085, Peoples R China
[4] Univ New Orleans, Dept Mech Engn, Composite Mat Res Lab, New Orleans, LA 70148 USA
基金
中国国家自然科学基金;
关键词
PIGEON-INSPIRED OPTIMIZATION; UAV; VERSATILE;
D O I
10.1061/JAEEEZ.ASENG-5053
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper proposes a multiple unmanned aerial vehicles (UAVs) cooperative landing algorithm based on deep reinforcement learning. First, to solve the partial observation problem, we propose the recurrent neural network to predict the moving platform trajectory. Afterwards, with the centralized multiagent framework, we present a parameter sharing method to realize multi-UAV cooperation. Finally, focusing on the sensor noise problem of the actual UAV flight, we propose a noise compensation recurrent proximal policy optimization (NC-RPPO) algorithm to extract images' features to compensate for inertial measurement unit (IMU) and GPS errors. We utilize AirSim to construct a simulated 3D environment resembling an offshore oil development zone. In this setting, we evaluate the effectiveness of our proposed multi-UAV cooperative landing algorithm while considering the presence of sensor noise. Through experimental trials, we demonstrate that our NC-RPPO algorithm enables UAVs to accurately predict the trajectory of a mobile platform and successfully land on it cooperatively in real time. Notably, the experimental outcomes obtained through our image-assisted noise correction method closely align with those obtained from the ground truth experiment.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Tracking Multiple Mobile Targets Using Cooperative Unmanned Aerial Vehicles
    Farmani, Negar
    Sun, Liang
    Pack, Daniel
    2015 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'15), 2015, : 395 - 400
  • [2] Formation cooperative trajectory tracking control for unmanned aerial vehicles via differential game and reinforcement learning
    Wang, Xiaoheng
    Xiao, Zhihe
    Ren, Ziming
    Dong, Chunzhu
    Tian, Xuan Dan
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2024,
  • [3] Control Platform for Multiple Unmanned Aerial Vehicles
    Zacarias, Iulisloi
    Leite, Carlos E. T.
    Schwarzrock, Janana
    de Freitas, Edison P.
    IFAC PAPERSONLINE, 2016, 49 (30): : 36 - 41
  • [4] Cooperatively pursuing a target unmanned aerial vehicle by multiple unmanned aerial vehicles based on multiagent reinforcement learning
    Wang X.
    Xuan S.
    Ke L.
    Advanced Control for Applications: Engineering and Industrial Systems, 2020, 2 (02):
  • [5] An autonomous differential evolution based on reinforcement learning for cooperative countermeasures of unmanned aerial vehicles
    Cao, Zijian
    Xu, Kai
    Jia, Haowen
    Fu, Yanfang
    Foh, Chuan Heng
    Tian, Feng
    APPLIED SOFT COMPUTING, 2025, 169
  • [6] Autonomous Landing of the Quadrotor on the Mobile Platform via Meta Reinforcement Learning
    Cao, Qianqian
    Liu, Ziyi
    Yu, Hai
    Liang, Xiao
    Fang, Yongchun
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 2269 - 2280
  • [7] Autonomous Landing of the Quadrotor on the Mobile Platform via Meta Reinforcement Learning
    Cao, Qianqian
    Liu, Ziyi
    Yu, Hai
    Liang, Xiao
    Fang, Yongchun
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 2269 - 2280
  • [8] Cooperative unmanned surface vehicles and unmanned aerial vehicles platform as a tool for coastal monitoring activities
    Wu, Jinshan
    Li, Ronghui
    Li, Jiawen
    Zou, Meichang
    Huang, Zijian
    OCEAN & COASTAL MANAGEMENT, 2023, 232
  • [9] Cooperative encirclement method for multiple unmanned ground vehicles based on reinforcement learning
    Su M.
    Wang Y.
    Pu R.
    Yu M.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2024, 46 (07): : 1237 - 1250
  • [10] Task Allocation of Multiple Unmanned Aerial Vehicles Based on Deep Transfer Reinforcement Learning
    Yin, Yongfeng
    Guo, Yang
    Su, Qingran
    Wang, Zhetao
    DRONES, 2022, 6 (08)