Cooperative Multi-Robot Task Allocation with Reinforcement Learning

被引:10
|
作者
Park, Bumjin [1 ]
Kang, Cheongwoong [1 ]
Choi, Jaesik [1 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Kim Jaechul Grad Sch AI, Daejeon 34141, South Korea
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 01期
关键词
multi robot task allocation; reinforcement learning; deep learning; artificial intelligence; TAXONOMY; COORDINATION;
D O I
10.3390/app12010272
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper deals with the concept of multi-robot task allocation, referring to the assignment of multiple robots to tasks such that an objective function is maximized. The performance of existing meta-heuristic methods worsens as the number of robots or tasks increases. To tackle this problem, a novel Markov decision process formulation for multi-robot task allocation is presented for reinforcement learning. The proposed formulation sequentially allocates robots to tasks to minimize the total time taken to complete them. Additionally, we propose a deep reinforcement learning method to find the best allocation schedule for each problem. Our method adopts the cross-attention mechanism to compute the preference of robots to tasks. The experimental results show that the proposed method finds better solutions than meta-heuristic methods, especially when solving large-scale allocation problems.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Learning Locally, Communicating Globally: Reinforcement Learning of Multi-robot Task Allocation for Cooperative Transport
    Shibata, Kazuki
    Jimbo, Tomohiko
    Odashima, Tadashi
    Takeshita, Keisuke
    Matsubara, Takamitsu
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 11436 - 11443
  • [2] Combining planning with reinforcement learning for multi-robot task allocation
    Strens, M
    Windelinckx, N
    [J]. ADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS II: ADAPTATION AND MULTI-AGENT LEARNING, 2005, 3394 : 260 - 274
  • [3] Cooperative Multi-Robot Hierarchical Reinforcement Learning
    Setyawan, Gembong Edhi
    Hartono, Pitoyo
    Sawada, Hideyuki
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (09) : 35 - 44
  • [4] Deep reinforcement learning path planning and task allocation for multi-robot collaboration
    Li, Zhixian
    Shi, Nianfeng
    Zhao, Liguo
    Zhang, Mengxia
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2024, 109 : 408 - 423
  • [5] Multi-robot learning in an inherently cooperative task
    Parker, LE
    Touzet, C
    [J]. UNMANNED GROUND VEHICLE TECHNOLOGY III, 2001, 4364 : 127 - 135
  • [6] Multi-robot learning in a cooperative observation task
    Parker, LE
    Touzet, C
    [J]. DISTRIBUTED AUTONOMOUS ROBOTIC SYSTEMS, 2000, : 391 - 401
  • [7] A Reinforcement Learning Algorithm in Cooperative Multi-Robot Domains
    Fernando Fern??ndez
    Daniel Borrajo
    Lynne E. Parker
    [J]. Journal of Intelligent and Robotic Systems, 2005, 43 : 161 - 174
  • [8] MULTI-ROBOT TASK ALLOCATION FOR FIRE-DISASTER RESPONSE BASED ON REINFORCEMENT LEARNING
    Tian, Yan-Tao
    Yang, Mao
    Qi, Xin-Yue
    Yang, Yong-Ming
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 2312 - 2317
  • [9] A reinforcement learning algorithm in cooperative multi-robot domains
    Fernández, F
    Borrajo, D
    Parker, LE
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2005, 43 (2-4) : 161 - 174
  • [10] Scalable Multi-Robot Task Allocation Using Graph Deep Reinforcement Learning with Graph Normalization
    Zhang, Zhenqiang
    Jiang, Xiangyuan
    Yang, Zhenfa
    Ma, Sile
    Chen, Jiyang
    Sun, Wenxu
    [J]. ELECTRONICS, 2024, 13 (08)