Cooperative Landing on Mobile Platform for Multiple Unmanned Aerial Vehicles via Reinforcement Learning

被引:1
|
作者
Xu, Yahao [1 ]
Li, Jingtai [2 ]
Wu, Bi [3 ]
Wu, Junqi [1 ]
Deng, Hongbin [1 ]
Hui, David [4 ]
机构
[1] Beijing Inst Technol, Sch Mechatron Engn, Beijing 100081, Peoples R China
[2] Minist Ind & Informat Technol, Equipment Ind Dev Ctr, Beijing 100804, Peoples R China
[3] Beijing Blue Sky Innovat Ctr Frontier Sci, Lab 1, Beijing 100085, Peoples R China
[4] Univ New Orleans, Dept Mech Engn, Composite Mat Res Lab, New Orleans, LA 70148 USA
基金
中国国家自然科学基金;
关键词
PIGEON-INSPIRED OPTIMIZATION; UAV; VERSATILE;
D O I
10.1061/JAEEEZ.ASENG-5053
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper proposes a multiple unmanned aerial vehicles (UAVs) cooperative landing algorithm based on deep reinforcement learning. First, to solve the partial observation problem, we propose the recurrent neural network to predict the moving platform trajectory. Afterwards, with the centralized multiagent framework, we present a parameter sharing method to realize multi-UAV cooperation. Finally, focusing on the sensor noise problem of the actual UAV flight, we propose a noise compensation recurrent proximal policy optimization (NC-RPPO) algorithm to extract images' features to compensate for inertial measurement unit (IMU) and GPS errors. We utilize AirSim to construct a simulated 3D environment resembling an offshore oil development zone. In this setting, we evaluate the effectiveness of our proposed multi-UAV cooperative landing algorithm while considering the presence of sensor noise. Through experimental trials, we demonstrate that our NC-RPPO algorithm enables UAVs to accurately predict the trajectory of a mobile platform and successfully land on it cooperatively in real time. Notably, the experimental outcomes obtained through our image-assisted noise correction method closely align with those obtained from the ground truth experiment.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Recognition of a landing platform for unmanned aerial vehicles by using computer vision-based techniques
    Garcia-Pulido, J. A.
    Pajares, G.
    Dormido, S.
    de la Cruz, J. M.
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 76 : 152 - 165
  • [42] Optimal Cooperative Thermalling of Unmanned Aerial Vehicles
    Klesh, Andrew T.
    Kabamba, Pierre T.
    Girard, Anouck R.
    OPTIMIZATION AND COOPERATIVE CONTROL STRATEGIES, 2009, 381 : 355 - 369
  • [43] Cooperative control of a group of unmanned aerial vehicles
    Jia, QL
    Yan, JG
    Wang, XM
    ISTM/2005: 6TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-9, CONFERENCE PROCEEDINGS, 2005, : 7872 - 7875
  • [44] Experiment Platform Design of Unmanned Aerial Vehicles and Research on Cooperative Autonomous Search Approach
    Luo, Huadong
    Ling, Haifeng
    Zhang, Guangna
    Zhu, Tao
    2018 10TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS (ICCCAS 2018), 2018, : 237 - 240
  • [45] Cooperative Visual-Range-Inertial Navigation for Multiple Unmanned Aerial Vehicles
    Li, Chunyu
    Wang, Jianan
    Liu, Junhui
    Shan, Jiayuan
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (06) : 7851 - 7865
  • [46] A review on fault-tolerant cooperative control of multiple unmanned aerial vehicles
    Ziquan YU
    Youmin ZHANG
    Bin JIANG
    Jun FU
    Ying JIN
    Chinese Journal of Aeronautics, 2022, 35 (01) : 1 - 18
  • [47] COOPERATIVE TASK PLANNING FOR MULTIPLE UNMANNED AERIAL VEHICLES USING A GENETIC ALGORITHM
    Geng, L.
    Zhang, Y. F.
    Wang, J. J.
    Fuh, Jerry Y. H.
    Teo, S. H.
    CONTROL AND INTELLIGENT SYSTEMS, 2014, 42 (02) : 119 - 125
  • [48] Toward developing an optimal cooperative search algorithm for multiple Unmanned Aerial Vehicles
    DeLima, Pedro
    Pack, Daniel
    PROCEEDINGS OF THE 2008 INTERNATIONAL SYMPOSIUM ON COLLABORATIVE TECHNOLOGIES AND SYSTEMS: CTS 2008, 2008, : 506 - 512
  • [49] Long-term Cooperative Tracking using Multiple Unmanned Aerial Vehicles
    Yang, Yue
    Zhai, Shuhang
    Ramesh, Bharath
    Zheng, Xiaoxu
    Xiang, Cheng
    Chen, Ben M.
    Lee, Tong Heng
    2016 12TH IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2016, : 56 - 61
  • [50] Cooperative control of multiple unmanned aerial vehicles using the potential field theory
    Eun, Yeonju
    Bang, Hyochoong
    JOURNAL OF AIRCRAFT, 2006, 43 (06): : 1805 - 1814