Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG

被引:0
|
作者
Qi, Guangjun [1 ]
Li, Yuan [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
关键词
DDPG; Reward Function; Demonstration; Six-DOF Arm Robot;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although the traditional robot arm grasping control has high control accuracy, its price is based on high-precision hardware and lacks flexibility. In order to achieve high control accuracy and flexibility on a relatively inexpensive robot arm. This paper proposes an improved DDPG (Deep Deterministic Policy Gradient) reinforcement learning algorithm to control the gripping of a robot arm. First, build a simulation environment for a six-DOF (six-degree-of-freedom) manipulator with a gripper in ROS (Robot Operating System). Then, aiming at the shortcomings of traditional DDPG rewards, research and design a composite reward function. Aiming at the problem of low sampling efficiency in the free exploration of the robot arm, a batch of teaching data was added to the experience replay pool to improve learning efficiency. The simulation experiment results show that under the same number of episode of training. The improved DDPG grasping control algorithm has significantly improved the grasping success rate. The grasping success rate after comprehensive improvement reaches 70%, which is higher than the 36% level of unimproved DDPG.
引用
收藏
页码:4132 / 4137
页数:6
相关论文
共 50 条
  • [1] Mobile Robot Path Planning Based on Improved DDPG Reinforcement Learning Algorithm
    Dong, Yuansheng
    Zou, Xingjie
    [J]. PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 52 - 55
  • [2] A Reinforcement-Learning Approach to Control Robotic Manipulator Based on Improved DDPG
    Majumder, Saikat
    Sahoo, Soumya Ranjan
    [J]. 2023 NINTH INDIAN CONTROL CONFERENCE, ICC, 2023, : 281 - 286
  • [3] Motion Control for Biped Robot via DDPG-based Deep Reinforcement Learning
    Wu, Xiaoguang
    Liu, Shaowei
    Zhang, Tianci
    Yang, Lei
    Li, Yanhui
    Wang, Tingjin
    [J]. 2018 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION (WRC SARA), 2018, : 40 - 45
  • [4] Adaptive PID computed-torque control of robot manipulators based on DDPG reinforcement learning
    Ghediri, Akram
    Lamamra, Kheireddine
    Kaki, Abdelaziz Ait
    Vaidyanathan, Sundarapandian
    [J]. INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2022, 41 (03) : 173 - 182
  • [5] An Improved DDPG Reinforcement Learning Control of Underwater Gliders for Energy Optimization
    Jing, Anyan
    Tang, Zuocheng
    Gao, Jian
    Pan, Guang
    [J]. PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 621 - 626
  • [6] Narrowband Active Noise Control with DDPG Based on Reinforcement Learning
    Ryu, Seokhoon
    Lim, Jihea
    Lee, Young-Sup
    [J]. INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2024,
  • [7] Learning-Based Template Matching for Robot Arm Grasping
    Le, Minh-Tri
    Lien, Jenn-Jier James
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1763 - 1768
  • [8] Energy Consumption Minimization of Quadruped Robot Based on Reinforcement Learning of DDPG Algorithm
    Yan, Zhenzhuo
    Ji, Hongwei
    Chang, Qing
    [J]. ACTUATORS, 2024, 13 (01)
  • [9] Motion Planning of Six-DOF Arm Robot Based on Improved DDPG Algorithm
    Li, Zhuang
    Ma, Hongbin
    Ding, Yazhe
    Wang, Chen
    Jin, Ying
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3954 - 3959
  • [10] Robot autonomous grasping and assembly skill learning based on deep reinforcement learning
    Chen, Chengjun
    Zhang, Hao
    Pan, Yong
    Li, Dongnian
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 130 (11-12): : 5233 - 5249