Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG

被引:0
|
作者
Qi, Guangjun [1 ]
Li, Yuan [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
关键词
DDPG; Reward Function; Demonstration; Six-DOF Arm Robot;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although the traditional robot arm grasping control has high control accuracy, its price is based on high-precision hardware and lacks flexibility. In order to achieve high control accuracy and flexibility on a relatively inexpensive robot arm. This paper proposes an improved DDPG (Deep Deterministic Policy Gradient) reinforcement learning algorithm to control the gripping of a robot arm. First, build a simulation environment for a six-DOF (six-degree-of-freedom) manipulator with a gripper in ROS (Robot Operating System). Then, aiming at the shortcomings of traditional DDPG rewards, research and design a composite reward function. Aiming at the problem of low sampling efficiency in the free exploration of the robot arm, a batch of teaching data was added to the experience replay pool to improve learning efficiency. The simulation experiment results show that under the same number of episode of training. The improved DDPG grasping control algorithm has significantly improved the grasping success rate. The grasping success rate after comprehensive improvement reaches 70%, which is higher than the 36% level of unimproved DDPG.
引用
收藏
页码:4132 / 4137
页数:6
相关论文
共 50 条
  • [31] Coordinated Transportation of Dual-arm Robot Based on Deep Reinforcement Learning
    Hao, Zixuan
    Chen, Gang
    Huang, Zeyuan
    Jia, Qingxuan
    Liu, Yu
    Yao, Zhipeng
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [32] Multifingered Grasping Based on Multimodal Reinforcement Learning
    Liang, Hongzhuo
    Cong, Lin
    Hendrich, Norman
    Li, Shuang
    Sun, Fuchun
    Zhang, Jianwei
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 1174 - 1181
  • [33] Flattening and folding towels with a single-arm robot based on reinforcement learning
    Shehawy, Hassan
    Pareyson, Daniele
    Caruso, Virginia
    De Bernardi, Stefano
    Zanchettin, Andrea Maria
    Rocco, Paolo
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 169
  • [34] Motion simulation of robot arm using reinforcement learning
    Oshiro, Takahito
    Watanabe, Kajiro
    PROCEEDINGS OF SICE ANNUAL CONFERENCE, VOLS 1-8, 2007, : 1073 - 1076
  • [35] Biological robot arm motion through reinforcement learning
    Izawa, J
    Kondo, T
    Ito, K
    SICE 2002: PROCEEDINGS OF THE 41ST SICE ANNUAL CONFERENCE, VOLS 1-5, 2002, : 413 - 418
  • [36] A robot arm digital twin utilising reinforcement learning
    Matulis, Marius
    Harvey, Carlo
    COMPUTERS & GRAPHICS-UK, 2021, 95 : 106 - 114
  • [37] Deep reinforcement learning method based on DDPG with simulated annealing for satellite attitude control system
    Su, Ruipeng
    Wu, Fengge
    Zhao, Junsuo
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 390 - 395
  • [38] Reinforcement Learning DDPG–PPO Agent-Based Control System for Rotary Inverted Pendulum
    Rajmeet Singh Bhourji
    Saeed Mozaffari
    Shahpour Alirezaee
    Arabian Journal for Science and Engineering, 2024, 49 : 1683 - 1696
  • [39] Stiffness Control for a Soft Robotic Finger based on Reinforcement Learning for Robust Grasping
    Dai, Junyue
    Zhu, Mingzhu
    Feng, Yu
    2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [40] Impedance control method with reinforcement learning for dual-arm robot installing slabstone
    Hu Heyu
    Cao Jianfu
    Journal of Mechanical Science and Technology, 2022, 36 : 2547 - 2558