A Novel Searching Method Using Reinforcement Learning Scheme for Multi-UAVs in Unknown Environments

被引:25
|
作者
Yue, Wei [1 ,2 ]
Guan, Xianhe [1 ]
Wang, Liyuan [2 ]
机构
[1] Dalian Maritime Univ, Sch Marine Elect Engn, Dalian 116000, Peoples R China
[2] Dalian Minzu Univ, Key Lab Intelligent Percept & Adv Control State E, Dalian 116600, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 22期
关键词
multi-UAV; cooperative search; reinforcement learning; dynamic target; TARGET;
D O I
10.3390/app9224964
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In this paper, the important topic of cooperative searches for multi-dynamic targets in unknown sea areas by unmanned aerial vehicles (UAVs) is studied based on a reinforcement learning (RL) algorithm. A novel multi-UAV sea area search map is established, in which models of the environment, UAV dynamics, target dynamics, and sensor detection are involved. Then, the search map is updated and extended using the concept of the territory awareness information map. Finally, according to the search efficiency function, a reward and punishment function is designed, and an RL method is used to generate a multi-UAV cooperative search path online. The simulation results show that the proposed algorithm could effectively perform the search task in the sea area with no prior information.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] A Novel Hybrid Auction Algorithm for Multi-UAVs Dynamic Task Assignment
    Duan, Xiaojun
    Liu, Huiying
    Tang, Hong
    Cai, Qing
    Zhang, Fan
    Han, Xiaotian
    IEEE ACCESS, 2020, 8 : 86207 - 86222
  • [32] A new search scheme using multi-bee-colony elite learning method for unmanned aerial vehicles in unknown environments
    Yue, Wei
    Li, Chaofan
    Liu, Zhongchang
    Li, Lili
    Wang, Liyuan
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2022, 43 (06): : 1645 - 1664
  • [33] Cooperative object recognition method of multi-UAVs based on decision fusion
    Li, Hongyao
    Xie, Xueli
    Du, Pengchun
    Xi, Jianxiang
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 5424 - 5429
  • [34] Path Planning of Multi-UAVs Concealment Attack Based on New A* Method
    Zhao Junwei
    Zhao Jianjun
    2014 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL 2, 2014, : 401 - 404
  • [35] Distributed Optimal Cooperative Formation Control Method for Multi-UAVs Systems
    Li, Junzhi
    Sun, Jingliang
    Long, Teng
    Wang, Yangjie
    Xu, Guangtong
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 6931 - 6936
  • [36] Multi-UAVs Cooperative Ground Moving Target Tracking and Positioning Method
    Qu, Yaohong
    Yang, Bing
    Song, Yuanjie
    Xu, Shengyang
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3471 - 3476
  • [37] Area Coverage Maximization of Multi UAVs Using Multi-Agent Reinforcement Learning
    Wijaya, Glenn B.
    Tamba, Tua A.
    2023 3RD INTERNATIONAL CONFERENCE ON ROBOTICS, AUTOMATION AND ARTIFICIAL INTELLIGENCE, RAAI 2023, 2023, : 1 - 4
  • [38] A Reinforcement Learning Method of Obstacle Avoidance for Industrial Mobile Vehicles in Unknown Environments Using Neural Network
    Xia, Chen
    El Kamel, A.
    PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT 2014, 2015, : 671 - 675
  • [39] Reinforcement Learning based Method for Autonomous Navigation of Mobile Robots in Unknown Environments
    Roan Van Hoa
    Tran Duc Chuyen
    Nguyen Tung Lam
    Tran Ngoc Son
    Nguyen Duc Dien
    Vu Thi To Linh
    2020 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2020, : 266 - 269
  • [40] Distributed formation tracking for multi-UAVs with unknown disturbances under event-triggered communication
    Chen, Tianxing
    Zhao, Jiasheng
    Hou, Zhiwei
    Chen, Hongbo
    Zhuang, Xuebin
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (12):