Path Planning for Ferry Crossing Inland Waterways Based on Deep Reinforcement Learning

被引:1
|
作者
Yuan, Xiaoli [1 ,2 ]
Yuan, Chengji [1 ,2 ]
Tian, Wuliu [3 ,4 ]
Liu, Gan [1 ,2 ]
Zhang, Jinfen [1 ,2 ,5 ]
机构
[1] Wuhan Univ Technol, Sch Transportat & Logist Engn, Wuhan 430063, Peoples R China
[2] Wuhan Univ Technol, Natl Engn Res Ctr Water Transport Safety WTS Ctr, Wuhan 430063, Peoples R China
[3] Beibu Gulf Univ, Maritime Coll, Qinzhou 535000, Peoples R China
[4] Wuhan Univ Technol, Hubei Key Lab Inland Shipping Technol, Wuhan 430063, Peoples R China
[5] Inland Port & Shipping Ind Res Co Ltd Guangdong Pr, Guangzhou 512100, Peoples R China
基金
中国国家自然科学基金;
关键词
deep reinforcement learning; DQN; autonomous navigation; ferry crossing behavior; OBSTACLE AVOIDANCE; ALGORITHM;
D O I
10.3390/jmse11020337
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Path planning is a key issue for safe navigation of inland ferries. With the development of ship intelligence, how to enhance the decision-support system of a ferry in a complex navigation environment is one of the key issues. The inland ferries need to cross the channel frequently and, thus, risky encounters with target ships in the waterway are more frequent, so they need an intelligent decision-support system that can deal with complex situations. In this study, a reinforced deep learning method is proposed for path planning of inland ferries during crossing of the waterways. In the study, the state space, action space and reward function of the Deep Q-network (DQN) model are designed and improved to establish an autonomous navigation method for ferries considering both economy and safety. The DQN model also takes into account the crossing behavior, navigation economy and safety. Finally, the model is applied to case studies to verify its effectiveness.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Vessel-following model for inland waterways based on deep reinforcement learning
    Hart, Fabian
    Okhrin, Ostap
    Treiber, Martin
    [J]. OCEAN ENGINEERING, 2023, 281
  • [2] Robot path planning based on deep reinforcement learning
    Long, Yinxin
    He, Huajin
    [J]. 2020 IEEE CONFERENCE ON TELECOMMUNICATIONS, OPTICS AND COMPUTER SCIENCE (TOCS), 2020, : 151 - 154
  • [3] UCAV Path Planning Algorithm Based on Deep Reinforcement Learning
    Zheng, Kaiyuan
    Gao, Jingpeng
    Shen, Liangxi
    [J]. IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 : 702 - 714
  • [4] Research on path planning of robot based on deep reinforcement learning
    Liu, Feng
    Chen, Chang
    Li, Zhihua
    Guan, Zhi-Hong
    Wang, Hua O.
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3730 - 3734
  • [5] A Deep Reinforcement Learning Based Approach for AGVs Path Planning
    Guo, Xinde
    Ren, Zhigang
    Wu, Zongze
    Lai, Jialun
    Zeng, Deyu
    Xie, Shengli
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 6833 - 6838
  • [6] A decentralized path planning model based on deep reinforcement learning
    Guo, Dong
    Ji, Shouwen
    Yao, Yanke
    Chen, Cheng
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 117
  • [7] A UAV Path Planning Method Based on Deep Reinforcement Learning
    Li, Yibing
    Zhang, Sitong
    Ye, Fang
    Jiang, Tao
    Li, Yingsong
    [J]. 2020 IEEE USNC-CNC-URSI NORTH AMERICAN RADIO SCIENCE MEETING (JOINT WITH AP-S SYMPOSIUM), 2020, : 93 - 94
  • [8] Multi-objective path planning based on deep reinforcement learning
    Xu, Jian
    Huang, Fei
    Cui, Yunfei
    Du, Xue
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3273 - 3279
  • [9] Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning
    Tang, Jin
    Liang, Yangang
    Li, Kebo
    [J]. DRONES, 2024, 8 (02)
  • [10] Improved Robot Path Planning Method Based on Deep Reinforcement Learning
    Han, Huiyan
    Wang, Jiaqi
    Kuang, Liqun
    Han, Xie
    Xue, Hongxin
    [J]. SENSORS, 2023, 23 (12)