Maximum Information Coverage and Monitoring Path Planning with Unmanned Surface Vehicles Using Deep Reinforcement Learning

被引:0
|
作者
Yanes Luis, Samuel [1 ]
Gutierrez Reina, Daniel [1 ]
Toral, Sergio [1 ]
机构
[1] Univ Seville, Seville, Spain
来源
关键词
Deep reinforcement learning; Informative path planning; Autonomous surface vehicles; WATER-RESOURCES;
D O I
10.1007/978-3-031-22039-5_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manual monitoring large water reservoirs is a complex and high-cost task that requires many human resources. By using Autonomous Surface Vehicles, informative missions for modeling and supervising can be performed efficiently. Given a model of the uncertainty of the measurements, the minimization of entropy is proven to be a suitable criterion to find a surrogate model of the contamination map, also with complete coverage pathplanning. This work uses Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to find a suitable policy that solves this maximum information coverage path planning, whereas the obstacles are avoided. The results show that the proposed framework outperforms other methods in the literature by 32% in entropy minimization and by 63% in model accuracy.
引用
下载
收藏
页码:13 / 24
页数:12
相关论文
共 50 条
  • [1] Learn to Navigate: Cooperative Path Planning for Unmanned Surface Vehicles Using Deep Reinforcement Learning
    Zhou, Xinyuan
    Wu, Peng
    Zhang, Haifeng
    Guo, Weihong
    Liu, Yuanchang
    IEEE ACCESS, 2019, 7 : 165262 - 165278
  • [2] Pursuit Path Planning for Multiple Unmanned Ground Vehicles Based on Deep Reinforcement Learning
    Guo, Hongda
    Xu, Youchun
    Ma, Yulin
    Xu, Shucai
    Li, Zhixiong
    ELECTRONICS, 2023, 12 (23)
  • [3] An Algorithm of Complete Coverage Path Planning for Unmanned Surface Vehicle Based on Reinforcement Learning
    Xing, Bowen
    Wang, Xiao
    Yang, Liu
    Liu, Zhenchong
    Wu, Qingyun
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (03)
  • [4] Coverage Path Planning Using Actor–Critic Deep Reinforcement Learning
    Garrido-Castañeda, Sergio Isahí
    Vasquez, Juan Irving
    Antonio-Cruz, Mayra
    Sensors, 2025, 25 (05)
  • [5] A coverage path planning approach for environmental monitoring using an unmanned surface vehicle
    Ramkumar Sudha S.K.
    Mishra D.
    Hameed I.A.
    Ocean Engineering, 2024, 310
  • [6] Intelligent controller for unmanned surface vehicles by deep reinforcement learning
    Lai, Pengyu
    Liu, Yi
    Zhang, Wei
    Xu, Hui
    PHYSICS OF FLUIDS, 2023, 35 (03)
  • [7] Cooperative Path Planning of Multiple Unmanned Surface Vehicles for Search and Coverage Task
    Zhao, Zhiyao
    Zhu, Bin
    Zhou, Yan
    Yao, Peng
    Yu, Jiabin
    DRONES, 2023, 7 (01)
  • [8] Survey on Coverage Path Planning with Unmanned Aerial Vehicles
    Cabreira, Taua M.
    Brisolara, Lisane B.
    Paulo R., Ferreira Jr.
    DRONES, 2019, 3 (01) : 1 - 38
  • [9] An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving
    Yang, Kai
    Liu, Li
    IEEE ACCESS, 2024, 12 : 67935 - 67944
  • [10] Deep hierarchical reinforcement learning based formation planning for multiple unmanned surface vehicles with experimental results
    Wei, Xiangwei
    Wang, Hao
    Tang, Yixuan
    OCEAN ENGINEERING, 2023, 286