UAV path planning algorithm based on Deep Q-Learning to search for a lost in the ocean

被引:1
|
作者
Boulares, Mehrez [1 ]
Fehri, Afef [1 ]
Jemni, Mohamed [1 ]
机构
[1] Univ Tunis, Higher Natl Sch Engineers Tunis ENSIT, Res Lab Technol Informat & Commun & Elect Engn LaT, Tunis, Tunisia
关键词
Search and Rescue (SAR); Reinforcement learning; UAV; Ocean currents;
D O I
10.1016/j.robot.2024.104730
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the context of real world application, Search and Rescue Missions on the ocean surface remain a complex task due to the large-scale area and the forces of the ocean currents, spreading lost targets and debris in an unpredictable way. In this work, we present a Path Planning Approach to search for a lost target on ocean surface using a swarm of UAVs. The combination of GlobCurrent dataset and a Lagrangian simulator is used to determine where the particles are moved by the ocean currents forces while Deep Q -learning algorithm is applied to learn from their dynamics. The evaluation results of the trained models show that our search strategy is effective and efficient. Over a total search area (red Sea zone), surface of 453422 Km 2 , we have shown that our strategy Search Success Rate is 98.61%, the maximum Search Time to detection is 15 days and the average Search Time to detection is almost 15 h.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [31] Path Planning Using Wasserstein Distributionally Robust Deep Q-learning
    Alpturk, Cem
    Renganathan, Venkatraman
    2023 EUROPEAN CONTROL CONFERENCE, ECC, 2023,
  • [32] Experience-Based Heuristic Search: Robust Motion Planning with Deep Q-Learning
    Bernhard, Julian
    Gieselmann, Robert
    Esterle, Klemens
    Knoll, Alois
    2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 3175 - 3182
  • [33] Dynamic Path Planning of a Mobile Robot with Improved Q-Learning algorithm
    Li, Siding
    Xu, Xin
    Zuo, Lei
    2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 409 - 414
  • [34] Extended Q-Learning Algorithm for Path-Planning of a Mobile Robot
    Goswami , Indrani
    Das, Pradipta Kumar
    Konar, Amit
    Janarthanan, R.
    SIMULATED EVOLUTION AND LEARNING, 2010, 6457 : 379 - +
  • [35] An optimized Q-Learning algorithm for mobile robot local path planning
    Zhou, Qian
    Lian, Yang
    Wu, Jiayang
    Zhu, Mengyue
    Wang, Haiyong
    Cao, Jinli
    KNOWLEDGE-BASED SYSTEMS, 2024, 286
  • [36] Ant colony pheromone aided Q-learning path planning algorithm
    Tian X.-H.
    Huo X.
    Zhou D.-L.
    Zhao H.
    Kongzhi yu Juece/Control and Decision, 2023, 38 (12): : 3345 - 3353
  • [37] Synergism of Firefly Algorithm and Q-Learning for Robot Arm Path Planning
    Sadhu, Arup Kumar
    Konar, Amit
    Bhattacharjee, Tanuka
    Das, Swagatam
    SWARM AND EVOLUTIONARY COMPUTATION, 2018, 43 : 50 - 68
  • [38] UAV Motion Strategies in Uncertain Dynamic Environments: A Path Planning Method Based on Q-Learning Strategy
    Cui, Jun-hui
    Wei, Rui-xuan
    Liu, Zong-cheng
    Zhou, Kai
    APPLIED SCIENCES-BASEL, 2018, 8 (11):
  • [39] The Method Based on Q-Learning Path Planning in Migrating Workflow
    Xiao, Song
    Wang, Xiao-lin
    PROCEEDINGS 2013 INTERNATIONAL CONFERENCE ON MECHATRONIC SCIENCES, ELECTRIC ENGINEERING AND COMPUTER (MEC), 2013, : 2204 - 2208
  • [40] Double deep Q-learning network-based path planning in UAV-assisted wireless powered NOMA communication networks
    Lei, Ming
    Fowler, Scott
    Wang, Juzhen
    Zhang, Xingjun
    Yu, Bocheng
    Yu, Bin
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,