Multi-Robot Path Planning Method Using Reinforcement Learning

被引:106
|
作者
Bae, Hyansu [1 ]
Kim, Gidong [2 ]
Kim, Jonguk [3 ]
Qian, Dianwei [4 ]
Lee, Sukgyu [1 ]
机构
[1] Yeungnam Univ, Dept Elect Engn, Gyongsan 38541, South Korea
[2] TycoAMP, Gyongsan 38541, South Korea
[3] Korea Polytech VII, Chang Won 51519, South Korea
[4] North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 15期
基金
新加坡国家研究基金会;
关键词
reinforcement learning; multi-robots; cooperation; Deep q learning; Convolution Neural Network; NEURAL-NETWORKS;
D O I
10.3390/app9153057
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper proposes a noble multi-robot path planning algorithm using Deep q learning combined with CNN (Convolution Neural Network) algorithm. In conventional path planning algorithms, robots need to search a comparatively wide area for navigation and move in a predesigned formation under a given environment. Each robot in the multi-robot system is inherently required to navigate independently with collaborating with other robots for efficient performance. In addition, the robot collaboration scheme is highly depends on the conditions of each robot, such as its position and velocity. However, the conventional method does not actively cope with variable situations since each robot has difficulty to recognize the moving robot around it as an obstacle or a cooperative robot. To compensate for these shortcomings, we apply Deep q learning to strengthen the learning algorithm combined with CNN algorithm, which is needed to analyze the situation efficiently. CNN analyzes the exact situation using image information on its environment and the robot navigates based on the situation analyzed through Deep q learning. The simulation results using the proposed algorithm shows the flexible and efficient movement of the robots comparing with conventional methods under various environments.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Cooperative multi-robot path planning using differential evolution
    Chakraborty, Jayasree
    Konar, Amit
    Jain, L. C.
    Chakraborty, Uday K.
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2009, 20 (1-2) : 13 - 27
  • [22] Swarm Reinforcement Learning Method for a Multi-Robot Formation Problem
    Iima, Hitoshi
    Kuroe, Yasuaki
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 2298 - 2303
  • [23] Path planning of multi-robot systems with cooperation
    Zhu, AM
    Yang, SX
    [J]. 2003 IEEE INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN ROBOTICS AND AUTOMATION, VOLS I-III, PROCEEDINGS, 2003, : 1028 - 1033
  • [24] Multi-robot Path Planning and Trajectory Smoothing
    Ali, Hub
    Xiong, Gang
    Wu, Huaiyu
    Hu, Bin
    Shen, Zhen
    Bai, Hongxing
    [J]. 2020 IEEE 16TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2020, : 685 - 690
  • [25] A Virtual Spring Method for the Multi-robot Path Planning and Formation Control
    Pan, Zhenhua
    Wang, Di
    Deng, Hongbin
    Li, Kewei
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2019, 17 (05) : 1272 - 1282
  • [26] MRPPSim: A Multi-Robot Path Planning Simulation
    Alotaibi, Ebtehal Turki Saho
    Al-Rawi, Hisham
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (08) : 145 - 155
  • [27] Multi-Robot Path Planning With Due Times
    Wang, Hanfu
    Chen, Weidong
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 4829 - 4836
  • [28] Optimal Path and Timetable Planning Method for Multi-Robot Optimal Trajectory
    Zhang, Chen
    Li, Yibin
    Zhou, Lelai
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) : 8130 - 8137
  • [29] A Multi-robot Task Allocation and Path Planning Method for Warehouse System
    Mei, Yulin
    Li, Sheng
    Chen, Chen
    Han, Andong
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 1911 - 1916
  • [30] A Virtual Spring Method for the Multi-robot Path Planning and Formation Control
    Zhenhua Pan
    Di Wang
    Hongbin Deng
    Kewei Li
    [J]. International Journal of Control, Automation and Systems, 2019, 17 : 1272 - 1282