Energy Consumption Minimization of Quadruped Robot Based on Reinforcement Learning of DDPG Algorithm

被引:3
|
作者
Yan, Zhenzhuo [1 ]
Ji, Hongwei [1 ]
Chang, Qing [1 ]
机构
[1] Tianjin Univ Commerce, Sch Mech Engn, Tianjin 300134, Peoples R China
关键词
quadruped robot; deep reinforcement learning; robot movement; energy efficiency;
D O I
10.3390/act13010018
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Energy consumption is one of the most critical factors in determining the kinematic performance of quadruped robots. However, existing research methods often encounter challenges in quickly and efficiently reducing the energy consumption associated with quadrupedal robotic locomotion. In this paper, the deep deterministic policy gradient (DDPG) algorithm was used to optimize the energy consumption of the Cyber Dog quadruped robot. Firstly, the kinematic and energy consumption models of the robot were established. Secondly, energy consumption was optimized by reinforcement learning using the DDPG algorithm. The optimized plantar trajectory was then compared with two common plantar trajectories in simulation experiments, with the same period and the number of synchronizations but varying velocities. Lastly, real experiments were conducted using a prototype machine to validate the simulation data. The analysis results show that, under the same conditions, the proposed method can reduce energy consumption by 7 similar to 9% compared with the existing optimal trajectory methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Gait Parameter Optimization of Quadruped Robot Under Energy Consumption Index Based on Reinforcement Learning
    Chen, Lu
    Ma, Hongxu
    Lang, Lin
    Liu, Xiangming
    Wei, Qing
    An, Honglei
    2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 972 - 977
  • [2] Mobile Robot Path Planning Based on Improved DDPG Reinforcement Learning Algorithm
    Dong, Yuansheng
    Zou, Xingjie
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 52 - 55
  • [3] Reinforcement Learning based Control of a Quadruped Robot
    Ancy, A.
    Jisha, V. R.
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [4] Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG
    Qi, Guangjun
    Li, Yuan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4132 - 4137
  • [5] Model Predictive Control of Quadruped Robot Based on Reinforcement Learning
    Zhang, Zhitong
    Chang, Xu
    Ma, Hongxu
    An, Honglei
    Lang, Lin
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [6] Research on Self-Recovery Control Algorithm of Quadruped Robot Fall Based on Reinforcement Learning
    Zhang, Guichen
    Liu, Hongwei
    Qin, Zihao
    Moiseev, Georgy V.
    Huo, Jianwen
    ACTUATORS, 2023, 12 (03)
  • [7] A strategy for push recovery in quadruped Robot based on reinforcement Learning
    Chen, Yang-zhen
    Hou, Wen-Qi
    Wang, Jian
    Wang, Jian-Wen
    Ma, Hong-xu
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 3145 - 3151
  • [8] Indoor energy-saving strategy optimization based on deep reinforcement learning and DDPG algorithm
    Wan, Yan
    Zhai, Yujia
    Cui, Can
    Song, Dexuan
    COMPUTING, 2025, 107 (01)
  • [9] Continual Reinforcement Learning for Quadruped Robot Locomotion
    Gai, Sibo
    Lyu, Shangke
    Zhang, Hongyin
    Wang, Donglin
    ENTROPY, 2024, 26 (01)
  • [10] A novel movies recommendation algorithm based on reinforcement learning with DDPG policy
    Zhou, Qiaoling
    INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2020, 13 (01) : 67 - 79