Efficient learning of robust quadruped bounding using pretrained neural networks

被引:2
|
作者
Wang, Zhicheng [1 ]
Li, Anqiao [1 ]
Zheng, Yixiao [1 ]
Xie, Anhuan [2 ]
Li, Zhibin [3 ]
Wu, Jun [1 ,4 ]
Zhu, Qiuguo [1 ,4 ]
机构
[1] Zhejiang Univ, Inst Cyber Syst & Control, Hangzhou, Zhejiang, Peoples R China
[2] Zhejiang Lab, Intelligent Robot Res Ctr, Hangzhou, Zhejiang, Peoples R China
[3] UCL, Dept Comp Sci, London, England
[4] Zhejiang Univ, State Key Lab Ind Control Technol, Hangzhou, Zhejiang, Peoples R China
关键词
legged locomotion; reinforcement learning; robot learning; GAITS;
D O I
10.1049/csy2.12062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body movements. The authors first pretrained the neural network (NN) based on data from a robot operated by conventional model-based controllers, and then further optimised the pretrained NN via deep reinforcement learning (DRL). In particular, the authors designed a reward function considering contact points and phases to enforce the gait symmetry and periodicity, which improved the bounding performance. The NN-based feedback controller was learned in the simulation and directly deployed on the real quadruped robot Jueying Mini successfully. A variety of environments are presented both indoors and outdoors with the authors' approach. The authors' approach shows efficient computing and good locomotion results by the Jueying Mini quadrupedal robot bounding over uneven terrain. The cover image is based on the Research Article Efficient learning of robust quadruped bounding using pretrained neural networks by Zhicheng Wang et al., .
引用
收藏
页码:331 / 338
页数:8
相关论文
共 50 条
  • [1] Neural networks and statistical inference: seeking robust and efficient learning
    Capobianco, E
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2000, 32 (3-4) : 443 - 454
  • [2] Efficient and Robust Supervised Learning Algorithm for Spiking Neural Networks
    Zhang Y.
    Geng T.
    Zhang M.
    Wu X.
    Zhou J.
    Qu H.
    [J]. Sensing and Imaging, 2018, 19 (1):
  • [3] NeuroDog: Quadruped Embodiment using Neural Networks
    Egan, Donal
    Cosker, Darren
    Mcdonnell, Rachel
    [J]. PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2023, 6 (03)
  • [4] The Effectiveness of Using a Pretrained Deep Learning Neural Networks for Object Classification in Underwater Video
    Szymak, Piotr
    Piskur, Pawel
    Naus, Krzysztof
    [J]. REMOTE SENSING, 2020, 12 (18)
  • [5] Emotion Recognition Using Pretrained Deep Neural Networks
    Dobes, Marek
    Sabolova, Natalia
    [J]. ACTA POLYTECHNICA HUNGARICA, 2023, 20 (04) : 195 - 204
  • [6] Ear Recognition Using Pretrained Convolutional Neural Networks
    Resmi, K. R.
    Raju, G.
    [J]. ADVANCES IN COMPUTING AND DATA SCIENCES, PT I, 2021, 1440 : 720 - 728
  • [7] Improved Bottleneck Features Using Pretrained Deep Neural Networks
    Yu, Dong
    Seltzer, Michael L.
    [J]. 12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 244 - 247
  • [8] Towards Robust and Reproducible Active Learning using Neural Networks
    Munjal, Prateek
    Hayat, Nasir
    Hayat, Munawar
    Sourati, Jamshid
    Khan, Shadab
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 223 - 232
  • [9] Brain Tumor Classification Using Pretrained Convolutional Neural Networks
    Daniel, Mihalas Constantin
    Ruxandra, Lascu Mihaela
    [J]. 2021 16TH INTERNATIONAL CONFERENCE ON ENGINEERING OF MODERN ELECTRIC SYSTEMS (EMES), 2021, : 130 - 133
  • [10] Detection of Diabetic Retinopathy Using Pretrained Deep Neural Networks
    Kajan, Slavomir
    Goga, Jozef
    Lacko, Kristian
    Pavlovicova, Jarmila
    [J]. PROCEEDINGS OF THE 2020 30TH INTERNATIONAL CONFERENCE CYBERNETICS & INFORMATICS (K&I '20), 2020,