Energy Consumption Minimization of Quadruped Robot Based on Reinforcement Learning of DDPG Algorithm

被引:3
|
作者
Yan, Zhenzhuo [1 ]
Ji, Hongwei [1 ]
Chang, Qing [1 ]
机构
[1] Tianjin Univ Commerce, Sch Mech Engn, Tianjin 300134, Peoples R China
关键词
quadruped robot; deep reinforcement learning; robot movement; energy efficiency;
D O I
10.3390/act13010018
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Energy consumption is one of the most critical factors in determining the kinematic performance of quadruped robots. However, existing research methods often encounter challenges in quickly and efficiently reducing the energy consumption associated with quadrupedal robotic locomotion. In this paper, the deep deterministic policy gradient (DDPG) algorithm was used to optimize the energy consumption of the Cyber Dog quadruped robot. Firstly, the kinematic and energy consumption models of the robot were established. Secondly, energy consumption was optimized by reinforcement learning using the DDPG algorithm. The optimized plantar trajectory was then compared with two common plantar trajectories in simulation experiments, with the same period and the number of synchronizations but varying velocities. Lastly, real experiments were conducted using a prototype machine to validate the simulation data. The analysis results show that, under the same conditions, the proposed method can reduce energy consumption by 7 similar to 9% compared with the existing optimal trajectory methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] A deep reinforcement learning algorithm based on modified Twin delay DDPG method for robotic applications
    Vasquez-Jalpa, Carlos
    Nakano-Miyatake, Mariko
    Escamilla-Hernandez, Enrique
    2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 743 - 748
  • [32] A Composite Control Strategy for Quadruped Robot by Integrating Reinforcement Learning and Model-Based Control
    Lyu, Shangke
    Zhao, Han
    Wang, Donglin
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 751 - 758
  • [33] Narrowband Active Noise Control with DDPG Based on Reinforcement Learning
    Ryu, Seokhoon
    Lim, Jihea
    Lee, Young-Sup
    INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2024, 25 (06) : 1389 - 1397
  • [34] An Improved DDPG Reinforcement Learning Control of Underwater Gliders for Energy Optimization
    Jing, Anyan
    Tang, Zuocheng
    Gao, Jian
    Pan, Guang
    PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 621 - 626
  • [35] Heuristic Gait Learning of Quadruped Robot Based on Deep Deterministic Policy Gradient Algorithm
    Wang, Mingchao
    Ruan, Xiaogang
    Zhu, Xiaoqing
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1046 - 1049
  • [36] Intelligent Navigation of Indoor Robot Based on Improved DDPG Algorithm
    He, Xuemei
    Kuang, Yin
    Song, Ning
    Liu, Fan
    Mathematical Problems in Engineering, 2023, 2023
  • [37] Reinforcement learning based demand charge minimization using energy storage
    Weber, Lucas
    Busic, Ana
    Zhu, Jiamin
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 4351 - 4357
  • [38] A Hierarchical Framework for Quadruped Locomotion Based on Reinforcement Learning
    Tan, Wenhao
    Fang, Xing
    Zhang, Wei
    Song, Ran
    Chen, Teng
    Zheng, Yu
    Li, Yibin
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 8462 - 8468
  • [39] Path Planning Based on ADFA* Algorithm for Quadruped Robot
    Li Zhe
    Li Yibin
    Rong Xuewen
    Zhang Hui
    IEEE ACCESS, 2019, 7 : 111095 - 111101
  • [40] DDPG-based Deep Reinforcement Learning for Loitering Munition Mobility Control: Algorithm Design and Visualization
    Lee, Hyunsoo
    Yun, Won Joon
    Jung, Soyi
    Kim, Jae-Hyun
    Kim, Joongheon
    2022 IEEE VTS ASIA PACIFIC WIRELESS COMMUNICATIONS SYMPOSIUM, APWCS, 2022, : 112 - 116