UAV path planning algorithm based on Deep Q-Learning to search for a lost in the ocean

被引:1
|
作者
Boulares, Mehrez [1 ]
Fehri, Afef [1 ]
Jemni, Mohamed [1 ]
机构
[1] Univ Tunis, Higher Natl Sch Engineers Tunis ENSIT, Res Lab Technol Informat & Commun & Elect Engn LaT, Tunis, Tunisia
关键词
Search and Rescue (SAR); Reinforcement learning; UAV; Ocean currents;
D O I
10.1016/j.robot.2024.104730
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the context of real world application, Search and Rescue Missions on the ocean surface remain a complex task due to the large-scale area and the forces of the ocean currents, spreading lost targets and debris in an unpredictable way. In this work, we present a Path Planning Approach to search for a lost target on ocean surface using a swarm of UAVs. The combination of GlobCurrent dataset and a Lagrangian simulator is used to determine where the particles are moved by the ocean currents forces while Deep Q -learning algorithm is applied to learn from their dynamics. The evaluation results of the trained models show that our search strategy is effective and efficient. Over a total search area (red Sea zone), surface of 453422 Km 2 , we have shown that our strategy Search Success Rate is 98.61%, the maximum Search Time to detection is 15 days and the average Search Time to detection is almost 15 h.
引用
下载
收藏
页数:15
相关论文
共 50 条
  • [21] Optimal path planning approach based on Q-learning algorithm for mobile robots
    Maoudj, Abderraouf
    Hentout, Abdelfetah
    APPLIED SOFT COMPUTING, 2020, 97
  • [22] CLSQL: Improved Q-Learning Algorithm Based on Continuous Local Search Policy for Mobile Robot Path Planning
    Ma, Tian
    Lyu, Jiahao
    Yang, Jiayi
    Xi, Runtao
    Li, Yuancheng
    An, Jinpeng
    Li, Chao
    SENSORS, 2022, 22 (15)
  • [23] ETQ-learning: an improved Q-learning algorithm for path planning
    Wang, Huanwei
    Jing, Jing
    Wang, Qianlv
    He, Hongqi
    Qi, Xuyan
    Lou, Rui
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (04) : 915 - 929
  • [24] A Modified Q-learning Multi Robot Path Planning Algorithm
    Li, Bo
    Liang, Hongbin
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 127 : 125 - 126
  • [25] A 3D Q-Learning Algorithm for Offline UAV Path Planning with Priority Shifting Rewards
    de Carvalho, Kevin Braathen
    Batista, Hiago B.
    de Oliveira, Iure L.
    Brandao, Alexandre S.
    2022 LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS), 2022 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR), AND 2022 WORKSHOP ON ROBOTICS IN EDUCATION (WRE), 2022, : 169 - 174
  • [26] Model based path planning using Q-Learning
    Sharma, Avinash
    Gupta, Kanika
    Kumar, Anirudha
    Sharma, Aishwarya
    Kumar, Rajesh
    2017 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2017, : 837 - 842
  • [27] An adaptive Q-learning based particle swarm optimization for multi-UAV path planning
    Tan L.
    Zhang H.
    Liu Y.
    Yuan T.
    Jiang X.
    Shang Z.
    Soft Computing, 2024, 28 (13-14) : 7931 - 7946
  • [28] Optimal path planning method based on epsilon-greedy Q-learning algorithm
    Bulut, Vahide
    JOURNAL OF THE BRAZILIAN SOCIETY OF MECHANICAL SCIENCES AND ENGINEERING, 2022, 44 (03)
  • [29] Path planning for mobile robot based on improved ant colony Q-learning algorithm
    Mengru Cui
    Maowei He
    Hanning Chen
    Kunpeng Liu
    Yabao Hu
    Chen Zheng
    Xuliang Wang
    International Journal on Interactive Design and Manufacturing (IJIDeM), 2025, 19 (4): : 3069 - 3087
  • [30] Optimal path planning method based on epsilon-greedy Q-learning algorithm
    Vahide Bulut
    Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2022, 44