Maximum Information Coverage and Monitoring Path Planning with Unmanned Surface Vehicles Using Deep Reinforcement Learning

被引:0
|
作者
Yanes Luis, Samuel [1 ]
Gutierrez Reina, Daniel [1 ]
Toral, Sergio [1 ]
机构
[1] Univ Seville, Seville, Spain
来源
关键词
Deep reinforcement learning; Informative path planning; Autonomous surface vehicles; WATER-RESOURCES;
D O I
10.1007/978-3-031-22039-5_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Manual monitoring large water reservoirs is a complex and high-cost task that requires many human resources. By using Autonomous Surface Vehicles, informative missions for modeling and supervising can be performed efficiently. Given a model of the uncertainty of the measurements, the minimization of entropy is proven to be a suitable criterion to find a surrogate model of the contamination map, also with complete coverage pathplanning. This work uses Proximal Policy Optimization, a Deep Reinforcement Learning algorithm, to find a suitable policy that solves this maximum information coverage path planning, whereas the obstacles are avoided. The results show that the proposed framework outperforms other methods in the literature by 32% in entropy minimization and by 63% in model accuracy.
引用
收藏
页码:13 / 24
页数:12
相关论文
共 50 条
  • [31] Evaluation and Enhancement of Resolution-Aware Coverage Path Planning Method for Surface Inspection Using Unmanned Aerial Vehicles
    Wu, Weitong
    Funabora, Yuki
    Doki, Shinji
    Doki, Kae
    Yoshikawa, Satoru
    Mitsuda, Tetsuji
    Xiang, Jingyu
    IEEE ACCESS, 2024, 12 : 16753 - 16766
  • [32] A Multiagent Deep Reinforcement Learning Approach for Path Planning in Autonomous Surface Vehicles: The Ypacarai Lake Patrolling Case
    Luis, Samuel Yanes
    Reina, Daniel Gutierrez
    Marin, Sergio L. Toral
    IEEE ACCESS, 2021, 9 : 17084 - 17099
  • [33] Data-based deep reinforcement learning and active FTC for unmanned surface vehicles
    Fan, Zhenyao
    Wang, Lipeng
    Meng, Hao
    Yang, Chunsheng
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (11):
  • [34] Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning
    Hu, Hui
    Wang, Yuge
    Tong, Wenjie
    Zhao, Jiao
    Gu, Yulei
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [35] Flocking of Under-Actuated Unmanned Surface Vehicles via Deep Reinforcement Learning and Model Predictive Path Integral Control
    Pan, Chao
    Peng, Zhouhua
    Li, Yongming
    Han, Bing
    Wang, Dan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 11
  • [36] Deep reinforcement learning-based controller for path following of an unmanned surface vehicle
    Woo, Joohyun
    Yu, Chanwoo
    Kim, Nakwan
    OCEAN ENGINEERING, 2019, 183 : 155 - 166
  • [37] Path planning for cooperative sensing using unmanned vehicles
    Tisdale, John
    Durrant-Whyte, Hugh
    Hedrick, J. Karl
    PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINERING CONGRESS AND EXPOSITION 2007, VOL 9, PTS A-C: MECHANICAL SYSTEMS AND CONTROL, 2008, : 715 - 723
  • [38] Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning
    Qian, Yubin
    Feng, Song
    Hu, Wenhao
    Wang, Wanqiu
    ADVANCES IN MECHANICAL ENGINEERING, 2022, 14 (12)
  • [39] Deep Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehicles
    Grando, Ricardo B.
    de Jesus, Junior C.
    Drews-Jr, Paulo L. J.
    2020 XVIII LATIN AMERICAN ROBOTICS SYMPOSIUM, 2020 XII BRAZILIAN SYMPOSIUM ON ROBOTICS AND 2020 XI WORKSHOP OF ROBOTICS IN EDUCATION (LARS-SBR-WRE 2020), 2020, : 335 - 340
  • [40] Cooperative Search Path Planning for Multiple Unmanned Surface Vehicles
    Zhao, Pengcheng
    Li, Jinming
    Mao, Zhaoyong
    Ding, Wenjun
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 3434 - 3445