Multi-UAV Redeployment Optimization Based on Multi-Agent Deep Reinforcement Learning Oriented to Swarm Performance Restoration

被引:1
|
作者
Wu, Qilong [1 ]
Geng, Zitao [1 ]
Ren, Yi [1 ]
Feng, Qiang [1 ]
Zhong, Jilong [2 ]
机构
[1] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
[2] Def Innovat Inst, Acad Mil Sci, Beijing 100071, Peoples R China
基金
中国国家自然科学基金;
关键词
distributed reconfiguration strategy; multi-agent deep reinforcement learning; unmanned aerial vehicle (UAV); UAV swarm redeployment; COVERAGE;
D O I
10.3390/s23239484
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Distributed artificial intelligence is increasingly being applied to multiple unmanned aerial vehicles (multi-UAVs). This poses challenges to the distributed reconfiguration (DR) required for the optimal redeployment of multi-UAVs in the event of vehicle destruction. This paper presents a multi-agent deep reinforcement learning-based DR strategy (DRS) that optimizes the multi-UAV group redeployment in terms of swarm performance. To generate a two-layer DRS between multiple groups and a single group, a multi-agent deep reinforcement learning framework is developed in which a QMIX network determines the swarm redeployment, and each deep Q-network determines the single-group redeployment. The proposed method is simulated using Python and a case study demonstrates its effectiveness as a high-quality DRS for large-scale scenarios.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] UAV Swarm Confrontation Based on Multi-agent Deep Reinforcement Learning
    Wang, Zhi
    Liu, Fan
    Guo, Jing
    Hong, Chen
    Chen, Ming
    Wang, Ershen
    Zhao, Yunbo
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 4996 - 5001
  • [2] Multi-Agent Deep Reinforcement Learning for Full-Duplex Multi-UAV Networks
    Dai, Chen
    Zhu, Kun
    Hossain, Ekram
    [J]. 2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 2232 - 2237
  • [3] Multi-UAV Path Planning and Following Based on Multi-Agent Reinforcement Learning
    Zhao, Xiaoru
    Yang, Rennong
    Zhong, Liangsheng
    Hou, Zhiwei
    [J]. DRONES, 2024, 8 (01)
  • [4] Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning
    Qie, Han
    Shi, Dianxi
    Shen, Tianlong
    Xu, Xinhai
    Li, Yuan
    Wang, Liujing
    [J]. IEEE ACCESS, 2019, 7 : 146264 - 146272
  • [5] Joint optimization of communication and mission performance for multi-UAV collaboration network: A multi-agent reinforcement learning method
    He, Yuan
    Xie, Jun
    Hu, Guyu
    Liu, Yaqun
    Luo, Xijian
    [J]. AD HOC NETWORKS, 2024, 164
  • [6] Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV Networks
    Zhao, Nan
    Liu, Zehua
    Cheng, Yiqiang
    [J]. IEEE ACCESS, 2020, 8 : 139670 - 139679
  • [7] An evolutionary multi-agent reinforcement learning algorithm for multi-UAV air combat
    Wang, Baolai
    Gao, Xianzhong
    Xie, Tao
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [8] Multi-UAV Escape Target Search: A Multi-Agent Reinforcement Learning Method
    Liao, Guang
    Wang, Jian
    Yang, Dujia
    Yang, Junan
    [J]. Sensors, 2024, 24 (21)
  • [9] Multi-Agent Deep Reinforcement Learning Based UAV Trajectory Optimization for Differentiated Services
    Ning, Zhaolong
    Yang, Yuxuan
    Wang, Xiaojie
    Song, Qingyang
    Guo, Lei
    Jamalipour, Abbas
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 5818 - 5834
  • [10] Multi-UAV Cooperative Searching and Tracking for Moving Targets Based on Multi-Agent Reinforcement Learning
    Su, Kai
    Qian, Feng
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (21):