Dynamic Path Planning for Multiple UAVs with Incomplete Information

被引:1
|
作者
Xue, Junjie [1 ]
Zhu, Jie [1 ]
Du, Jiangtao [2 ]
Kang, Weijie [3 ]
Xiao, Jiyang [1 ]
机构
[1] Air Force Engn Univ, Air Traff Control & Nav Coll, Xian 710038, Peoples R China
[2] Harbin Engn Univ, Sch Aerosp & Architectural Engn, Harbin 150006, Peoples R China
[3] Rocket Force Univ Engn, Dept Elect Engn, Xian 710025, Peoples R China
关键词
UAVs; path planning; incomplete information; MADDPG; reinforcement learning; RESOLUTION;
D O I
10.3390/electronics12040980
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To address the dynamic path planning for multiple UAVs using incomplete information, this paper studies real-time conflict detection and intelligent resolution methods. When the UAVs execute the task under the condition of incomplete information, the mission strategy of different UAVs may conflict with each other due to the difference in target, departure place, time and other factors. Based on the multi-agent deep deterministic policy gradient algorithm (MADDPG), we designed new global reward and partial local reward functions for the UAVs' path planning and named the improved algorithm as a complex memory driver-MADDPG (CMD-MADDPG). Thus, the trained UAVs can effectively and efficiently perform path planning tasks in conditions of incomplete information (each UAV does not know its reward function and so on). Finally, the simulation verifies that the proposed method can realize fast and accurate dynamic path planning for multiple UAVs.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Cooperative path planning for multiple UAVs in dynamic and uncertain environments
    Bellingham, JS
    Tillerson, M
    Alighanbari, M
    How, JP
    [J]. PROCEEDINGS OF THE 41ST IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 2002, : 2816 - 2822
  • [2] Multiple UAVs Cooperative Path Planning Based on Dynamic Bayesian Network
    Guo, Wenqiang
    Gao, Xiaoguang
    Xiao, Qinkun
    [J]. 2008 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-11, 2008, : 2401 - 2405
  • [3] 3D Path Planning for Multiple UAVs for Maximum Information Collection
    Ergezer, Halit
    Leblebicioglu, Kemal
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2014, 73 (1-4) : 737 - 762
  • [4] 3D Path Planning for Multiple UAVs for Maximum Information Collection
    Halit Ergezer
    Kemal Leblebicioğlu
    [J]. Journal of Intelligent & Robotic Systems, 2014, 73 : 737 - 762
  • [5] Path Planning for UAVs for Maximum Information Collection
    Ergezer, Halit
    Leblebicioglu, Kemal
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2013, 49 (01) : 502 - 520
  • [6] Path planning of multiple UAVs using MMACO and DE algorithm in dynamic environment
    Ali, Zain Anwar
    Han, Zhangang
    Di, Zhengru
    [J]. MEASUREMENT & CONTROL, 2023, 56 (3-4): : 459 - 469
  • [7] Dynamic Obstacle Avoidance Path Planning of UAVs
    Xue Qian
    Cheng Peng
    Cheng Nong
    Zou Xiang
    [J]. 2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 8860 - 8865
  • [8] Cooperative Path Planning for Multiple UAVs Formation
    Zhen, Ziyang
    Gao, Chen
    Zhao, Qiannan
    Ding, Ruyi
    [J]. 2014 IEEE 4TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2014, : 469 - 473
  • [9] Differential geometric path planning of multiple UAVs
    Shanmugavel, Madhavan
    Tsourdos, Antonios
    White, Brian A.
    Zbikowski, Rafael
    [J]. JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2007, 129 (05): : 620 - 632
  • [10] Developing an effective algorithm for dynamic UAV path planning with incomplete threat information
    Gao, X.
    Ren, J.
    Chen, D.
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2012, 226 (G4) : 413 - 421