A Novel Searching Method Using Reinforcement Learning Scheme for Multi-UAVs in Unknown Environments

被引:25
|
作者
Yue, Wei [1 ,2 ]
Guan, Xianhe [1 ]
Wang, Liyuan [2 ]
机构
[1] Dalian Maritime Univ, Sch Marine Elect Engn, Dalian 116000, Peoples R China
[2] Dalian Minzu Univ, Key Lab Intelligent Percept & Adv Control State E, Dalian 116600, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 22期
关键词
multi-UAV; cooperative search; reinforcement learning; dynamic target; TARGET;
D O I
10.3390/app9224964
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In this paper, the important topic of cooperative searches for multi-dynamic targets in unknown sea areas by unmanned aerial vehicles (UAVs) is studied based on a reinforcement learning (RL) algorithm. A novel multi-UAV sea area search map is established, in which models of the environment, UAV dynamics, target dynamics, and sensor detection are involved. Then, the search map is updated and extended using the concept of the territory awareness information map. Finally, according to the search efficiency function, a reward and punishment function is designed, and an RL method is used to generate a multi-UAV cooperative search path online. The simulation results show that the proposed algorithm could effectively perform the search task in the sea area with no prior information.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A New Searching Approach Using Improved Multi-Ant Colony Scheme for Multi-UAVs in Unknown Environments
    Yue, Wei
    Xi, Yun
    Guan, Xianhe
    IEEE ACCESS, 2019, 7 : 161094 - 161102
  • [2] Cooperative Search Strategy of Multi-UAVs Based on Reinforcement Learning
    Zhao, Hongyin
    Cui, Donghui
    Hao, Mingrui
    Xu, Xin
    Liu, Zhenchang
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 3407 - 3415
  • [3] Advances in Cooperative Target Searching by Multi-UAVs
    Wang, Changjian
    Zhang, Xiaoming
    Lei, Yingbo
    Wu, Hang
    Liu, Hang
    Xie, Lele
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2022, PT II, 2022, : 25 - 34
  • [4] Dynamic Channel Allocation for Multi-UAVs: A Deep Reinforcement Learning Approach
    Zhou, Xianglong
    Lin, Yun
    Tu, Ya
    Mao, Shiwen
    Dou, Zheng
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [5] Target detection for multi-UAVs via digital pheromones and navigation algorithm in unknown environments
    Yan Shao
    Zhi-feng Zhao
    Rong-peng Li
    Yu-geng Zhou
    Frontiers of Information Technology & Electronic Engineering, 2020, 21 : 796 - 808
  • [6] Multi-UAVs Strategies for Ad Hoc Network with Multi-Agent Reinforcement Learning
    Karimata, George
    Nakazato, Jin
    Tran, Gia Khanh
    Suto, Katsuya
    Tsukada, Manabu
    Esaki, Hiroshi
    38TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN 2024, 2024, : 726 - 729
  • [7] Reinforcement Learning based Approach for Multi-UAV Cooperative Searching in Unknown Environments
    Yue, Wei
    Guan, Xianhe
    Xi, Yun
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2018 - 2023
  • [8] Target detection for multi-UAVs via digital pheromones and navigation algorithm in unknown environments
    Shao, Yan
    Zhao, Zhi-feng
    Li, Rong-peng
    Zhou, Yu-geng
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2020, 21 (05) : 796 - 808
  • [9] Cooperation Scheme of Multi-UAVs for Evacuation Guidance Support
    Katayama, Kenta
    Takahashi, Hideyuki
    Yokota, Nobuhide
    Sugiyasu, Kazuya
    Kinoshita, Tetsuo
    2018 IEEE 7TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE 2018), 2018, : 221 - 222
  • [10] Environment Information Coherence in Multi-UAVs Cooperative Area Searching
    Peng Hui
    Zhang Qing-jie
    Li Yuan
    Shen Lin-cheng
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 3115 - 3120