Efficient learning of robust quadruped bounding using pretrained neural networks

被引:2
|
作者
Wang, Zhicheng [1 ]
Li, Anqiao [1 ]
Zheng, Yixiao [1 ]
Xie, Anhuan [2 ]
Li, Zhibin [3 ]
Wu, Jun [1 ,4 ]
Zhu, Qiuguo [1 ,4 ]
机构
[1] Zhejiang Univ, Inst Cyber Syst & Control, Hangzhou, Zhejiang, Peoples R China
[2] Zhejiang Lab, Intelligent Robot Res Ctr, Hangzhou, Zhejiang, Peoples R China
[3] UCL, Dept Comp Sci, London, England
[4] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou, Zhejiang, Peoples R China
关键词
legged locomotion; reinforcement learning; robot learning; GAITS;
D O I
10.1049/csy2.12062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body movements. The authors first pretrained the neural network (NN) based on data from a robot operated by conventional model-based controllers, and then further optimised the pretrained NN via deep reinforcement learning (DRL). In particular, the authors designed a reward function considering contact points and phases to enforce the gait symmetry and periodicity, which improved the bounding performance. The NN-based feedback controller was learned in the simulation and directly deployed on the real quadruped robot Jueying Mini successfully. A variety of environments are presented both indoors and outdoors with the authors' approach. The authors' approach shows efficient computing and good locomotion results by the Jueying Mini quadrupedal robot bounding over uneven terrain. The cover image is based on the Research Article Efficient learning of robust quadruped bounding using pretrained neural networks by Zhicheng Wang et al., .
引用
收藏
页码:331 / 338
页数:8
相关论文
共 50 条
  • [22] Efficient learning in spiking neural networks
    Rast, Alexander
    Aoun, Mario Antoine
    Elia, Eleni G.
    Crook, Nigel
    [J]. NEUROCOMPUTING, 2024, 597
  • [23] Robust learning of parsimonious deep neural networks
    Guenter, Valentin Frank Ingmar
    Sideris, Athanasios
    [J]. NEUROCOMPUTING, 2024, 566
  • [24] The study of the robust learning algorithm for neural networks
    Yamawaki, Shigenobu
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 2, PROCEEDINGS, 2006, 4252 : 866 - 870
  • [25] Neural networks with robust backpropagation learning algorithm
    Walczak, B
    [J]. ANALYTICA CHIMICA ACTA, 1996, 322 (1-2) : 21 - 29
  • [26] Operations and learning in neural networks for robust prediction
    Kogiantis, AG
    PapantoniKazakos, T
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1997, 27 (03): : 402 - 411
  • [27] Robust Neural Networks Learning: New Approaches
    Shibzukhov, Z. M.
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2018, 2018, 10878 : 247 - 255
  • [28] Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks
    Marmanis, Dimitrios
    Datcu, Mihai
    Esch, Thomas
    Stilla, Uwe
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (01) : 105 - 109
  • [29] Efficient Gastrointestinal Disease Classification Using Pretrained Deep Convolutional Neural Network
    Noor, Muhammad Nouman
    Nazir, Muhammad
    Khan, Sajid Ali
    Song, Oh-Young
    Ashraf, Imran
    [J]. ELECTRONICS, 2023, 12 (07)
  • [30] Differentiable neural architecture learning for efficient neural networks
    Guo, Qingbei
    Wu, Xiao-Jun
    Kittler, Josef
    Feng, Zhiquan
    [J]. PATTERN RECOGNITION, 2022, 126