Redundant Robot Control Using Multi Agent Reinforcement Learning

被引:0
|
作者
Perrusquia, Adolfo [1 ]
Yu, Wen [1 ]
Li, Xiaoou [2 ]
机构
[1] CINVESTAV IPN Natl Polytech Inst, Dept Control Automat, Av IPN 2508, Mexico City 07360, DF, Mexico
[2] CINVESTAV IPN Natl Polytech Inst, Dept Comp, Mexico City 07360, DF, Mexico
关键词
INVERSE KINEMATICS SOLUTION; TRACKING CONTROL; TASK-SPACE; TRAJECTORY TRACKING; NEURAL-NETWORK;
D O I
10.1109/case48305.2020.9216774
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Robot control in task-space1 needs the inverse kinematics and Jacobian matrix. They are not available for redundant robots, because there are so many degrees-offreedom (DOF). Intelligent learning methods, such as neural networks (NN) and reinforcement learning (RL) can learn them. However, NN needs big data and RL is not suitable for multilink robots as the redundant robots. In this paper, we propose a full cooperative multi-agent reinforcement learning (MARL) to solve the above problems. Each joint of the robot is regarded as one agent. Although the dimension of the learning space is very large, the full cooperative MARL uses the kinematic learning and avoids the function approximators in large learning space. The experimental results show that our MARL is much more better compared with the classic methods such as, Jacobian-based methods and neural networks.
引用
收藏
页码:1650 / 1655
页数:6
相关论文
共 50 条
  • [21] Multi-agent behavioral control system using deep reinforcement learning
    Ngoc Duy Nguyen
    Thanh Nguyen
    Nahavandi, Saeid
    [J]. NEUROCOMPUTING, 2019, 359 : 58 - 68
  • [22] Multi-Arm Robot Task Planning for Fruit Harvesting Using Multi-Agent Reinforcement Learning
    Li, Tao
    Xie, Feng
    Qiu, Quan
    Feng, Qingchun
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 4176 - 4183
  • [23] Integrating Robot Assignment and Maintenance Management: A Multi-Agent Reinforcement Learning Approach for Holistic Control
    Bhatta, Kshitij
    Chang, Qing
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (09) : 5338 - 5344
  • [24] Heterogeneous Multi-Robot Cooperation With Asynchronous Multi-Agent Reinforcement Learning
    Zhang, Han
    Zhang, Xiaohui
    Feng, Zhao
    Xiao, Xiaohui
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (01): : 159 - 166
  • [25] Multi-Agent Deep Reinforcement Learning for Multi-Robot Applications: A Survey
    Orr, James
    Dutta, Ayan
    [J]. SENSORS, 2023, 23 (07)
  • [26] Multi-Robot Formation Control using Collective Behavior Model and Reinforcement Learning
    Liu, Jung-Chun
    Liu, Tsung-Te
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 2261 - 2265
  • [27] Position control of a mobile robot using reinforcement learning
    Farias, G.
    Garcia, G.
    Montenegro, G.
    Fabregas, E.
    Dormido-Canto, S.
    Dormido, S.
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 17393 - 17398
  • [28] Multi-agent Coordination using Reinforcement Learning with a Relay Agent
    Zemzem, Wiem
    Tagina, Moncef
    [J]. ICEIS: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS - VOL 1, 2017, : 537 - 545
  • [29] Coordinated Slicing and Admission Control Using Multi-Agent Deep Reinforcement Learning
    Sulaiman, Muhammad
    Moayyedi, Arash
    Ahmadi, Mahdieh
    Salahuddin, Mohammad A.
    Boutaba, Raouf
    Saleh, Aladdin
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02): : 1110 - 1124
  • [30] Extended Variable Speed Limit control using Multi-agent Reinforcement Learning
    Kusic, Kresimir
    Dusparic, Ivana
    Gueriau, Maxime
    Greguric, Martin
    Ivanjko, Edouard
    [J]. 2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,