Collision avoidance in multi-robot systems based on multi-layered reinforcement learning

被引:14
|
作者
Arai, Y
Fujii, T
Asama, H
Kaetsu, H
Endo, I
机构
[1] Iwate Prefectural Univ, Fac Software & Informat Sci, Morioka, Iwate 0200173, Japan
[2] RIKEN, Inst Phys & Chem Res, Wako, Saitama 3510198, Japan
关键词
collision avoidance; reinforcement learning; multi-layered learning; local communication; mobile robot;
D O I
10.1016/S0921-8890(99)00035-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is important for a robot to acquire adaptive behaviors for avoiding surrounding robots and obstacles in complicated environments. Although the introduction of a learning scheme is expected to be one of the solutions for this purpose, a large size of memory and a large calculation cost are required to handle useful information such as motions of robots. In this paper, we introduce the multi-layered reinforcement learning method. By dividing a learning curriculum into multiple layers, the number of expected situations can be reduced. It is shown that real robots can adaptively avoid collision with each other and to obstacles in a complicated situation. (C) 1999 Elsevier Science B.V. All right reserved.
引用
收藏
页码:21 / 32
页数:12
相关论文
共 50 条
  • [21] Velocity Obstacle for Polytopic Collision Avoidance for Distributed Multi-Robot Systems
    Huang, Jihao
    Zeng, Jun
    Chi, Xuemin
    Sreenath, Koushil
    Liu, Zhitao
    Su, Hongye
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3502 - 3509
  • [22] Distributed Non-Communicating Multi-Robot Collision Avoidance via Map-Based Deep Reinforcement Learning
    Chen, Guangda
    Yao, Shunyi
    Ma, Jun
    Pan, Lifan
    Chen, Yu'an
    Xu, Pei
    Ji, Jianmin
    Chen, Xiaoping
    SENSORS, 2020, 20 (17) : 1 - 33
  • [23] Collision Avoidance for Persistent Monitoring in Multi-Robot Systems with Intersecting Trajectories
    Soltero, Daniel E.
    Smith, Stephen L.
    Rus, Daniela
    2011 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2011, : 3645 - 3652
  • [24] Cooperative Event Triggered Control for Multi-Robot Systems with Collision Avoidance
    Li, Xiaoduo
    Yin, Xiang
    Li, Shaoyuan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 5460 - 5465
  • [25] Reinforcement learning in the multi-robot domain
    Mataric, MJ
    AUTONOMOUS ROBOTS, 1997, 4 (01) : 73 - 83
  • [26] Multi-robot cooperation based on hierarchical reinforcement learning
    Cheng, Xiaobei
    Shen, Jing
    Liu, Haibo
    Gu, Guochang
    COMPUTATIONAL SCIENCE - ICCS 2007, PT 3, PROCEEDINGS, 2007, 4489 : 90 - +
  • [27] Reinforcement Learning in the Multi-Robot Domain
    Maja J. Matarić
    Autonomous Robots, 1997, 4 : 73 - 83
  • [28] Synthesis of Multi-robot Formation Manoeuvre and Collision Avoidance
    Yang, Aolei
    Naeem, Wasif
    Fei, Minrui
    Liu, Li
    Tu, Xiaowei
    COMPUTATIONAL INTELLIGENCE, NETWORKED SYSTEMS AND THEIR APPLICATIONS, 2014, 462 : 533 - 542
  • [29] Cooperative Flocking and Learning in Multi-Robot Systems for Predator Avoidance
    La, Hung Manh
    Lim, Ronny Salim
    Sheng, Weihua
    Chen, Jiming
    2013 IEEE 3RD ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL AND INTELLIGENT SYSTEMS (CYBER), 2013, : 337 - +
  • [30] Velocity Obstacle Based on Vertical Ellipse for Multi-Robot Collision Avoidance
    Zhu, Xiaomin
    Yi, Jianjun
    Ding, Hongkai
    He, Liang
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 99 (01) : 183 - 208