COLREGs-Compliant Multi-Ship Collision Avoidance Based on Multi-Agent Reinforcement Learning Technique

被引:13
|
作者
Wei, Guan [1 ]
Kuo, Wang [1 ]
机构
[1] Dalian Maritime Univ, Nav Coll, Dalian 116026, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-ship collision avoidance; COLREGs; multi-agent reinforcement learning; ORCA; ship maneuverability;
D O I
10.3390/jmse10101431
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
The congestion of waterways can easily lead to traffic hazards. Moreover, according to the data, the majority of sea collisions are caused by human error and the failure to comply with the Convention on the International Regulation for the preventing Collision at Sea (COLREGs). To avoid this situation, ship automatic collision avoidance has become one of the most important research issues in the field of marine engineering. In this study, an efficient method is proposed to solve multi-ship collision avoidance problems based on the multi-agent reinforcement learning (MARL) algorithm. Firstly, the COLREGs and ship maneuverability are considered for achieving multi-ship collision avoidance. Subsequently, the Optimal Reciprocal Collision Avoidance (ORCA) algorithm is utilized to detect and reduce the risk of collision. Ships can operate at the safe velocity computed by the ORCA algorithm to avoid collisions. Finally, the Nomoto three-degrees-of-freedom (3-DOF) model is used to simulate the maneuvers of ships. According to the above information and algorithms, this study designs and improves the state space, action space and reward function. For validating the effectiveness of the method, this study designs various simulation scenarios with thorough performance evaluations. The simulation results indicate that the proposed method is flexible and scalable in solving multi-ship collision avoidance, complying with COLREGs in various scenarios.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Multi-ship collaborative collision avoidance strategy based on multi-agent deep reinforcement learning
    Huang, Renxian
    Luo, Liang
    [J]. Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (06): : 1972 - 1988
  • [2] COLREGs-compliant multiship collision avoidance based on deep reinforcement learning
    Zhao, Luman
    Roh, Myung-Il
    [J]. OCEAN ENGINEERING, 2019, 191
  • [3] A COLREGs-Compliant Collision Avoidance Decision Approach Based on Deep Reinforcement Learning
    Wang, Weiqiang
    Huang, Liwen
    Liu, Kezhong
    Wu, Xiaolie
    Wang, Jingyao
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (07)
  • [4] A Multi-Ship Collision Avoidance Algorithm Using Data-Driven Multi-Agent Deep Reinforcement Learning
    Niu, Yihan
    Zhu, Feixiang
    Wei, Moxuan
    Du, Yifan
    Zhai, Pengyu
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (11)
  • [5] Ship cooperative collision avoidance strategy based on multi-agent deep reinforcement learning
    Sui L.-R.
    Gao S.
    He W.
    [J]. Kongzhi yu Juece/Control and Decision, 2023, 38 (05): : 1395 - 1402
  • [6] A composite learning method for multi-ship collision avoidance based on reinforcement learning and inverse control
    Xie, Shuo
    Chu, Xiumin
    Zheng, Mao
    Liu, Chenguang
    [J]. NEUROCOMPUTING, 2020, 411 (411) : 375 - 392
  • [7] Optimizing Multi-Vessel Collision Avoidance Decision Making for Autonomous Surface Vessels: A COLREGs-Compliant Deep Reinforcement Learning Approach
    Xie, Weidong
    Gang, Longhui
    Zhang, Mingheng
    Liu, Tong
    Lan, Zhixun
    [J]. JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (03)
  • [8] Collision-avoidance path planning for multi-ship encounters considering ship manoeuvrability and COLREGs
    He, Yixiong
    Li, Zhaoran
    Mou, Junmin
    Hu, Weixuan
    Li, Liling
    Wang, Bing
    [J]. TRANSPORTATION SAFETY AND ENVIRONMENT, 2021, 3 (02) : 103 - 113
  • [9] COLREGs-Compliant Unmanned Surface Vehicles Collision Avoidance Based on Multi-Objective Genetic Algorithm
    Ning, Jun
    Chen, Hanmin
    Li, Tieshan
    Li, Wei
    Li, Chunze
    [J]. IEEE ACCESS, 2020, 8 : 190367 - 190377
  • [10] COLREGS-Compliant collision avoidance for physically coupled multi-vessel systems with distributed MPC
    Du, Zhe
    Negenborn, Rudy R.
    Reppa, Vasso
    [J]. OCEAN ENGINEERING, 2022, 260