Path Planning for Automatic Berthing Using Ship-Maneuvering Simulation-Based Deep Reinforcement Learning

被引:3
|
作者
Vo, Anh Khoa [1 ]
Mai, Thi Loan [2 ]
Yoon, Hyeon Kyu [2 ]
机构
[1] Changwon Natl Univ, Dept Smart Environm Energy Engn, Chang Won 51140, South Korea
[2] Changwon Natl Univ, Dept Naval Architecture & Marine Engn, Chang Won 51140, South Korea
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 23期
关键词
path planning; deep reinforcement learning; TD3; maneuvering simulation; automatic berthing;
D O I
10.3390/app132312731
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Despite receiving much attention from researchers in the field of naval architecture and marine engineering since the early stages of modern shipbuilding, the berthing phase is still one of the biggest challenges in ship maneuvering due to the potential risks involved. Many algorithms have been proposed to solve this problem. This paper proposes a new approach with a path-planning algorithm for automatic berthing tasks using deep reinforcement learning (RL) based on a maneuvering simulation. Unlike the conventional path-planning algorithm using the control theory or an advanced algorithm using deep learning, a state-of-the-art path-planning algorithm based on reinforcement learning automatically learns, explores, and optimizes the path for berthing performance through trial and error. The results of performing the twin delayed deep deterministic policy gradient (TD3) combined with the maneuvering simulation show that the approach can be used to propose a feasible and safe path for high-performing automatic berthing tasks.
引用
收藏
页数:16
相关论文
共 50 条
  • [11] Research on path planning of robot based on deep reinforcement learning
    Liu, Feng
    Chen, Chang
    Li, Zhihua
    Guan, Zhi-Hong
    Wang, Hua O.
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3730 - 3734
  • [12] A Deep Reinforcement Learning Based Approach for AGVs Path Planning
    Guo, Xinde
    Ren, Zhigang
    Wu, Zongze
    Lai, Jialun
    Zeng, Deyu
    Xie, Shengli
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 6833 - 6838
  • [13] A decentralized path planning model based on deep reinforcement learning
    Guo, Dong
    Ji, Shouwen
    Yao, Yanke
    Chen, Cheng
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 117
  • [14] A UAV Path Planning Method Based on Deep Reinforcement Learning
    Li, Yibing
    Zhang, Sitong
    Ye, Fang
    Jiang, Tao
    Li, Yingsong
    2020 IEEE USNC-CNC-URSI NORTH AMERICAN RADIO SCIENCE MEETING (JOINT WITH AP-S SYMPOSIUM), 2020, : 93 - 94
  • [15] Automatic Music Playlist Generation via Simulation-based Reinforcement Learning
    Tomasi, Federico
    Cauteruccio, Joseph
    Kanoria, Surya
    Ciosek, Kamil
    Rinaldi, Matteo
    Dai, Zhenwen
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 4948 - 4957
  • [16] COLREGs-Based Path Planning for USVs Using the Deep Reinforcement Learning Strategy
    Wen, Naifeng
    Long, Yundong
    Zhang, Rubo
    Liu, Guanqun
    Wan, Wenjie
    Jiao, Dian
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (12)
  • [17] Coverage Path Planning Using Actor–Critic Deep Reinforcement Learning
    Garrido-Castañeda, Sergio Isahí
    Vasquez, Juan Irving
    Antonio-Cruz, Mayra
    Sensors, 2025, 25 (05)
  • [18] Mobile Service Robot Path Planning Using Deep Reinforcement Learning
    Kumaar, A. A. Nippun
    Kochuvila, Sreeja
    IEEE ACCESS, 2023, 11 : 100083 - 100096
  • [19] Real Time Path Planning of Robot using Deep Reinforcement Learning
    Raajan, Jeevan
    Srihari, P., V
    Satya, Jayadev P.
    Bhikkaji, B.
    Pasumarthy, Ramkrishna
    IFAC PAPERSONLINE, 2020, 53 (02): : 15602 - 15607
  • [20] Multi-objective path planning based on deep reinforcement learning
    Xu, Jian
    Huang, Fei
    Cui, Yunfei
    Du, Xue
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3273 - 3279