Robot motor skill acquisition based on episodic memory and meta learning

被引:0
|
作者
Liu, Dong [1 ,2 ]
Yu, Honghua [1 ]
Cong, Ming [1 ]
Wang, Zitu [1 ]
机构
[1] School of Mechanical Engineering, Dalian University of Technology, Dalian,116024, China
[2] Dalian University of Technology Jiangsu Research Institute, Changzhou,213164, China
关键词
Learning systems - Brain - Manipulators - Robots;
D O I
10.13245/j.hust.211211
中图分类号
学科分类号
摘要
Aiming at the problem of robots using past experience and knowledge to guide new task learning for few shot learning, the episodic memory was used to model the robot's experience, and an episodic-guided robot skill learning method was proposed based on meta-learning to achieve efficient learning of new tasks with few samples. The episodic memory was integrated to model the robot experience. During the learning process, the task experience passed by the meta-learner was stored as episodic memory through the encoder. In the process of guiding the learning of new tasks, the tasks were addressed hierarchically through the key value feature vector. The behaviors in the scene were extracted and combined until the task was completed. A meta-learning model was built based on a meta-learning network with long short term memory (LSTM) network as the core, and a normalization strategy and SeLU activation function were used to optimize the model to improve the robustness of the model. The UR3e robotic manipulator was used to train and test in simulation environment and real environment. The experimental results show that the proposed learning method has a success rate and good generalization in learning similar tasks with few shot learning. © 2021, Editorial Board of Journal of Huazhong University of Science and Technology. All right reserved.
引用
收藏
页码:57 / 63
相关论文
共 50 条
  • [1] Robot Motor Skill Acquisition with Learning in Two Spaces
    Fu, Jian
    Cao, Ce
    Du, Jinyu
    Shen, Siyuan
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PART VI, 2019, 11745 : 379 - 389
  • [2] Learning styles in motor skill acquisition
    Laguna, PL
    [J]. JOURNAL OF SPORT & EXERCISE PSYCHOLOGY, 2001, 23 : S76 - S76
  • [3] Robot Skill Acquisition by Demonstration and Explorative Learning
    Nemec, Bojan
    Ude, Ales
    [J]. NEW TRENDS IN MEDICAL AND SERVICE ROBOTS: CHALLENGES AND SOLUTIONS, 2014, 20 : 163 - 175
  • [4] The learning curve of skill acquisition on the SEP robot
    Malik, M.
    Bahsoun, A. N.
    Ahmed, K.
    Dasgupta, P.
    [J]. BRITISH JOURNAL OF SURGERY, 2012, 99 : 52 - 53
  • [5] Fast Robot Motor Skill Acquisition Based on Bayesian Inspired Policy Improvement
    Fu, Jian
    Shen, Siyuan
    Cao, Ce
    Li, Cong
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PART VI, 2019, 11745 : 356 - 367
  • [6] A Reinforcement Learning-Based Framework for Robot Manipulation Skill Acquisition
    Liu, Dong
    Wang, Zitu
    Lu, Binpeng
    Cong, Ming
    Yu, Honghua
    Zou, Qiang
    [J]. IEEE ACCESS, 2020, 8 : 108429 - 108437
  • [7] Effects of Autonomous Learning on Motor Skill Acquisition
    Chen, Jing-shuang
    [J]. PROCEEDINGS OF THE XI'AN 2012 INTERNATIONAL CONFERENCE OF SPORT SCIENCE & PHYSICAL EDUCATION, VOL III: PHYSICAL EDUCATION AND HEALTH, 2012, : 321 - 323
  • [8] A meta-analysis of part-whole research on motor skill acquisition and learning
    Templet, ET
    Hebert, EP
    [J]. RESEARCH QUARTERLY FOR EXERCISE AND SPORT, 2002, 73 (01) : A54 - A54
  • [9] Motor skill learning of quadruped robot based on environmental feedback mechanism
    Zhang, Si-Yuan
    Zhu, Xiao-Qing
    Ruan, Xiao-Gang
    Li, Chun-Yang
    Liu, Xin-Yuan
    [J]. Kongzhi yu Juece/Control and Decision, 2024, 39 (05): : 1461 - 1468
  • [10] Reinforcement Learning with Memory Based Automatic Chunking for Complex Skill Acquisition
    Singh, Shweta
    Katti, Sudaman
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 : 570 - 573