Path Planning for Automatic Berthing Using Ship-Maneuvering Simulation-Based Deep Reinforcement Learning

被引:3
|
作者
Vo, Anh Khoa [1 ]
Mai, Thi Loan [2 ]
Yoon, Hyeon Kyu [2 ]
机构
[1] Changwon Natl Univ, Dept Smart Environm Energy Engn, Chang Won 51140, South Korea
[2] Changwon Natl Univ, Dept Naval Architecture & Marine Engn, Chang Won 51140, South Korea
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 23期
关键词
path planning; deep reinforcement learning; TD3; maneuvering simulation; automatic berthing;
D O I
10.3390/app132312731
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Despite receiving much attention from researchers in the field of naval architecture and marine engineering since the early stages of modern shipbuilding, the berthing phase is still one of the biggest challenges in ship maneuvering due to the potential risks involved. Many algorithms have been proposed to solve this problem. This paper proposes a new approach with a path-planning algorithm for automatic berthing tasks using deep reinforcement learning (RL) based on a maneuvering simulation. Unlike the conventional path-planning algorithm using the control theory or an advanced algorithm using deep learning, a state-of-the-art path-planning algorithm based on reinforcement learning automatically learns, explores, and optimizes the path for berthing performance through trial and error. The results of performing the twin delayed deep deterministic policy gradient (TD3) combined with the maneuvering simulation show that the approach can be used to propose a feasible and safe path for high-performing automatic berthing tasks.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Path Planning for Mobile Robot Based on Deep Reinforcement Learning and Fuzzy Control
    Liu, Chunling
    Xu, Jun
    Guo, Kaiwen
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 533 - 537
  • [42] Path Planning for Ferry Crossing Inland Waterways Based on Deep Reinforcement Learning
    Yuan, Xiaoli
    Yuan, Chengji
    Tian, Wuliu
    Liu, Gan
    Zhang, Jinfen
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (02)
  • [43] Target Tracking and Path Planning of Mobile Sensor Based on Deep Reinforcement Learning
    Zhang, Kun
    Hu, Yuanjiang
    Huang, Deqing
    Yin, Zijie
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 190 - 195
  • [44] A novel path planning approach for unmanned ships based on deep reinforcement learning
    Chen, Chen
    Ma, Feng
    Liu, Jia-Lun
    Yan, Xin-Ping
    Chen, Xian-Qiao
    DATA SCIENCE AND KNOWLEDGE ENGINEERING FOR SENSING DECISION SUPPORT, 2018, 11 : 626 - 633
  • [45] An Autonomous Path Planning Model for Unmanned Ships Based on Deep Reinforcement Learning
    Guo, Siyu
    Zhang, Xiuguo
    Zheng, Yisong
    Du, Yiquan
    SENSORS, 2020, 20 (02)
  • [46] Mobile Robot Path Planning Method Based on Deep Reinforcement Learning Algorithm
    Meng, Haitao
    Zhang, Hengrui
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (15)
  • [47] Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning
    Zhang, Kai
    Wang, Guile
    Hu, Jinwen
    Xu, Zhao
    Guo, Chubing
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 8392 - 8397
  • [48] Robot Search Path Planning Method Based on Prioritized Deep Reinforcement Learning
    Yanglong Liu
    Zuguo Chen
    Yonggang Li
    Ming Lu
    Chaoyang Chen
    Xuzhuo Zhang
    International Journal of Control, Automation and Systems, 2022, 20 : 2669 - 2680
  • [49] Path planning in an unknown environment based on deep reinforcement learning with prior knowledge
    Lou, Ping
    Xu, Kun
    Jiang, Xuemei
    Xiao, Zheng
    Yan, Junwei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (06) : 5773 - 5789
  • [50] Deep reinforcement learning-based path planning of underactuated surface vessels
    Xu H.
    Wang N.
    Zhao H.
    Zheng Z.
    Cyber-Physical Systems, 2019, 5 (01): : 1 - 17