Cooperative Search Strategy of Multi-UAVs Based on Reinforcement Learning

被引:0
|
作者
Zhao, Hongyin [1 ]
Cui, Donghui [1 ]
Hao, Mingrui [1 ]
Xu, Xin [1 ]
Liu, Zhenchang [1 ]
机构
[1] Sci & Technol Complex Syst Control & Intelligent, Beijing, Peoples R China
关键词
Multi-UAVs; Cooperative search; Area coverage search; Multi agent reinforcement learning;
D O I
10.1007/978-981-99-0479-2_314
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the cooperative search problem of multiple unmanned aerial vehicles for moving targets in unknown areas in a wide area, a cooperative search strategy training method based on reinforcement learning is proposed. This method is based on Markov decision model, centralized training and distributed execution. Through strategy sharing, the dimension of reinforcement learning training process is reduced, and the dynamic environment problem is processed by fusing pheromone model. The simulation shows that the cooperative search training method based on reinforcement learning is not affected by the target movement, and can adapt to different search areas, so that the UAV cluster has the functions of cooperative search in unknown areas and online obstacle avoidance and re planning. Compared with the traditional push sweep search method, the search algorithm based on reinforcement learning training performs better when the search area is wide and the target moves fast.
引用
收藏
页码:3407 / 3415
页数:9
相关论文
共 50 条
  • [1] Network Building and Communication Strategy Designing for Multi-UAVs Cooperative Search
    Fu Xiaowei
    Gao Xiaoguang
    [J]. 2016 14TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2016,
  • [2] Multi-UAVs Cooperative Reconnaissance Based on Improved Harmony Search Algorithm
    Zhang Yao-zhong
    Chen Lan
    [J]. 2018 5TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE 2018), 2018, : 346 - 350
  • [3] Cooperative target search and tracking for multi-UAVs based on control barrier functions
    Wang, Weizhen
    Chen, Xin
    Li, Li
    Zhang, Min
    [J]. TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2023, 45 (13) : 2582 - 2589
  • [4] Method of Multi-UAVs cooperative search for Markov moving targets
    Zhong, Yun
    Yao, Peiyang
    Sun, Yu
    Yang, Juan
    [J]. 2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 6783 - 6789
  • [5] Cooperative pursuit strategy for multi-UAVs based on DE-MADDPG algorithm
    Fu, Xiaowei
    Wang, Hui
    Xu, Zhe
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2022, 43 (05):
  • [6] Cooperative Jamming of Multi-UAVs Based on Improved Biopheromone
    Li, Shiju
    Wei, Chen
    Deng, Yimin
    Wang, Qite
    [J]. Lecture Notes in Electrical Engineering, 2022, 644 LNEE : 1721 - 1734
  • [7] Multi-UAVs Cooperative Area Search with No-fly Zones Constraints
    Liu Bo
    Wei Guangwei
    Xi Wenqing
    Fu Xiaowei
    [J]. 2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 6038 - 6042
  • [8] Multi-UAVs Cooperative Target Tracking
    Cao Jianao
    Fan Zhicheng
    Wang Yuanwen
    Sui Songchen
    Liang Pei
    Yuan Yulong
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 4944 - 4948
  • [9] Cooperative Search Method for Multiple UAVs Based on Deep Reinforcement Learning
    Gao, Mingsheng
    Zhang, Xiaoxuan
    [J]. SENSORS, 2022, 22 (18)
  • [10] An Optimal Control Strategy for Multi-UAVs Target Tracking and Cooperative Competition
    Yang, Yiguo
    Liao, Liefa
    Yang, Hong
    Li, Shuai
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (12) : 1931 - 1947