Multi-Robot Path Planning Method Using Reinforcement Learning

被引:104
|
作者
Bae, Hyansu [1 ]
Kim, Gidong [2 ]
Kim, Jonguk [3 ]
Qian, Dianwei [4 ]
Lee, Sukgyu [1 ]
机构
[1] Yeungnam Univ, Dept Elect Engn, Gyongsan 38541, South Korea
[2] TycoAMP, Gyongsan 38541, South Korea
[3] Korea Polytech VII, Chang Won 51519, South Korea
[4] North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 15期
基金
新加坡国家研究基金会;
关键词
reinforcement learning; multi-robots; cooperation; Deep q learning; Convolution Neural Network; NEURAL-NETWORKS;
D O I
10.3390/app9153057
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper proposes a noble multi-robot path planning algorithm using Deep q learning combined with CNN (Convolution Neural Network) algorithm. In conventional path planning algorithms, robots need to search a comparatively wide area for navigation and move in a predesigned formation under a given environment. Each robot in the multi-robot system is inherently required to navigate independently with collaborating with other robots for efficient performance. In addition, the robot collaboration scheme is highly depends on the conditions of each robot, such as its position and velocity. However, the conventional method does not actively cope with variable situations since each robot has difficulty to recognize the moving robot around it as an obstacle or a cooperative robot. To compensate for these shortcomings, we apply Deep q learning to strengthen the learning algorithm combined with CNN algorithm, which is needed to analyze the situation efficiently. CNN analyzes the exact situation using image information on its environment and the robot navigates based on the situation analyzed through Deep q learning. The simulation results using the proposed algorithm shows the flexible and efficient movement of the robots comparing with conventional methods under various environments.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Deep reinforcement learning path planning and task allocation for multi-robot collaboration
    Li, Zhixian
    Shi, Nianfeng
    Zhao, Liguo
    Zhang, Mengxia
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2024, 109 : 408 - 423
  • [2] Multi-Robot Path Planning for Mobile Sensing through Deep Reinforcement Learning
    Wei, Yongyong
    Zheng, Rong
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [3] Deep Reinforcement Learning for Multi-Robot Local Path Planning in Dynamic Environments
    Cong-Thanh Vu
    Liu, Yen-Chen
    [J]. 13TH INTERNATIONAL WORKSHOP ON ROBOT MOTION AND CONTROL, ROMOCO 2024, 2024, : 267 - 272
  • [4] Multi-robot path planning based on a deep reinforcement learning DQN algorithm
    Yang Yang
    Li Juntao
    Peng Lingling
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2020, 5 (03) : 177 - 183
  • [5] Multi-robot Formation Control Using Reinforcement Learning Method
    Zuo, Guoyu
    Han, Jiatong
    Han, Guansheng
    [J]. ADVANCES IN SWARM INTELLIGENCE, PT 1, PROCEEDINGS, 2010, 6145 : 667 - 674
  • [6] Path planning for multi-robot systems using PSO and Critical Path Schedule Method
    Han, Songyang
    Zhou, Xianzhong
    Chen, Chunlin
    [J]. 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING, AND CONTROL (ICNSC), 2016,
  • [7] Path Planning for Multi-robot Systems Using PSO and Critical Path Schedule Method
    Han, Songyang
    Zhou, Xianzhong
    Chen, Chunlin
    [J]. 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING, AND CONTROL (ICNSC), 2016,
  • [8] Combining planning with reinforcement learning for multi-robot task allocation
    Strens, M
    Windelinckx, N
    [J]. ADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS II: ADAPTATION AND MULTI-AGENT LEARNING, 2005, 3394 : 260 - 274
  • [9] Distributed safe reinforcement learning for multi-robot motion planning
    Lu, Yang
    Guo, Yaohua
    Zhao, Guoxiang
    Zhu, Minghui
    [J]. 2021 29TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2021, : 1209 - 1214
  • [10] Multi-robot Path Planning Using Petri Nets
    Zhang, Hongbin
    Luo, Jiliang
    Long, Jinjun
    Huang, Yisheng
    Wu, Weimin
    [J]. VERIFICATION AND EVALUATION OF COMPUTER AND COMMUNICATION SYSTEMS, VECOS 2020, 2020, 12519 : 15 - 26