A Novel Searching Method Using Reinforcement Learning Scheme for Multi-UAVs in Unknown Environments

被引:25
|
作者
Yue, Wei [1 ,2 ]
Guan, Xianhe [1 ]
Wang, Liyuan [2 ]
机构
[1] Dalian Maritime Univ, Sch Marine Elect Engn, Dalian 116000, Peoples R China
[2] Dalian Minzu Univ, Key Lab Intelligent Percept & Adv Control State E, Dalian 116600, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 22期
关键词
multi-UAV; cooperative search; reinforcement learning; dynamic target; TARGET;
D O I
10.3390/app9224964
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In this paper, the important topic of cooperative searches for multi-dynamic targets in unknown sea areas by unmanned aerial vehicles (UAVs) is studied based on a reinforcement learning (RL) algorithm. A novel multi-UAV sea area search map is established, in which models of the environment, UAV dynamics, target dynamics, and sensor detection are involved. Then, the search map is updated and extended using the concept of the territory awareness information map. Finally, according to the search efficiency function, a reward and punishment function is designed, and an RL method is used to generate a multi-UAV cooperative search path online. The simulation results show that the proposed algorithm could effectively perform the search task in the sea area with no prior information.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] A Combined Hierarchical Reinforcement Learning Based Approach For Multi-robot Cooperative Target Searching in Complex Unknown Environments
    Cai, Yifan
    Yang, Simon X.
    Xu, Xin
    PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2013, : 52 - 59
  • [22] Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment
    Xue, Yuntao
    Chen, Weisheng
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 2290 - 2303
  • [23] Method of Multi-UAVs cooperative search for Markov moving targets
    Zhong, Yun
    Yao, Peiyang
    Sun, Yu
    Yang, Juan
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 6783 - 6789
  • [24] Cooperative searching for the multi-UAVs based on dual-attribute probability model optimization
    Huang J.
    Sun W.
    Gao Y.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2020, 42 (01): : 118 - 127
  • [25] Navigation of autonomous vehicles in unknown environments using reinforcement learning
    Martinez-Marin, Tomas
    Rodriguez, Rafael
    2007 IEEE INTELLIGENT VEHICLES SYMPOSIUM, VOLS 1-3, 2007, : 964 - +
  • [26] A collaborative control method for multi-UAVs based on ADRC control
    Liu, Fuchun
    Lan, Tao
    Wang, Songbo
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7014 - 7019
  • [27] Spectrum Sharing Scheme for Multi-UAVs Relay Network Based on Matching Theory
    Zhang, Jingmin
    Liu, Xiaomin
    Li, Lixin
    Yang, Fucheng
    Dong, Qi
    Yue, Xiaokui
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT IV, 2019, 11743 : 84 - 92
  • [28] A Distributed Approach for Autonomous Landmine Detection Using Multi-UAVs
    Nath, Amar
    Niyogi, Rajdeep
    ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 1, AINA 2024, 2024, 199 : 166 - 177
  • [29] Design of search and rescue system using autonomous Multi-UAVs
    Choutri, Kheireddine
    Mohand, Lagha
    Dala, Laurent
    INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2020, 14 (04): : 553 - 564
  • [30] Multi-UAVs Collaboration System based on Machine Learning for Throughput Maximization
    Park, Yu Min
    Lee, Minkyung
    Hong, Choong Seon
    2019 20TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2019,