A Dynamic Movement Primitives-Based Tool Use Skill Learning and Transfer Framework for Robot Manipulation

被引:1
|
作者
Lu, Zhenyu [1 ]
Wang, Ning [1 ]
Yang, Chenguang [1 ,2 ]
机构
[1] Univ West England, Bristol Robot Lab, Bristol BS16 1QY, Avon, England
[2] Univ Liverpool, Dept Comp Sci, Liverpool L69 3BX, Merseyside, England
基金
英国工程与自然科学研究理事会;
关键词
Dynamic movement primitives; robot learning; skill transfer; multi-tool use skill; robot manipulation; MOTION;
D O I
10.1109/TASE.2024.3370139
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a framework for learning and transferring robot tool-use skills based on Dynamic Movement Primitives (DMPs) for robot fine manipulation. DMPs and their enhanced methods are employed to acquire a specific tool-use skill applicable to tools with similar sizes, shapes, and uses. However, the acquired skills may not be transferable to other scenarios and tools with variations. The new framework introduces two new types of skills based on DMPs: Object Operating (O2) skill and Tool Flipping (TF) skill. The O2 skill enables robots to handle tools for manipulating objects to achieve desired effects. The learning process for the O2 skill considers limitations imposed by tools and the environment during human demonstrations. Distinguishing between whether constraints can be modelled or not, we propose both a model-based and a constraint-based method to separate a constraint-irrelevant (CI) skill and the constrained conditions. The CI skill is generalized using a novel method called constrained -DMP lite, enabling adaptation to new tasks with special tools. The TF skill addresses situations where tools must generate an action to alter contacting positions on both objects and tools while avoiding conflicts during movement. Finally, the TF and O2 skills are generalized to be applied in creating a continuous action chain. We conduct several experiments to compare and analyze the advantages and disadvantages of the proposed methods with other approaches in terms of generalizability and calculation complexity. Note to Practitioners-Strengthening robot tool-use ability has been a hot research topic in recent years because these tools can extend the reachability and enhance the flexibility of robots. The previous research on DMPs has been utilized for learning tool-use skills. However, the learned skills few considered the tools' special use regulations, therefore the skill of using a tool is hard to transfer to another tool-use case. This paper explores tool-use skill learning and transfer between different tools by developing a framework based on the DMPs for this problem. The framework consists of two kinds of skills: O2 skill and TF skill with different purposes as well as a series of newly developed algorithms, such as constrained -DMP lite, a model-based and a constraint-based CI skill learning methods. These methods can separate the constraints from human demonstrations of using tools to achieve a CI skill and generalize the CI skill according to the constraints generated from a new tool-use manipulation task. We verify the effectiveness of the proposed framework through some typical tool-use experiments, including pushing objects, cutting and obstacle avoidance in actuality. The development of this framework can be used in industrial and house working scenarios.
引用
收藏
页码:1748 / 1763
页数:16
相关论文
共 50 条
  • [21] A Reinforcement Learning-Based Framework for Robot Manipulation Skill Acquisition
    Liu, Dong
    Wang, Zitu
    Lu, Binpeng
    Cong, Ming
    Yu, Honghua
    Zou, Qiang
    IEEE ACCESS, 2020, 8 : 108429 - 108437
  • [22] MT-RSL: A multitasking-oriented robot skill learning framework based on continuous dynamic movement primitives for improving efficiency and quality in robot-based intelligent operation
    Ning, Yuming
    Li, Tuanjie
    Yao, Cong
    Du, Wenqian
    Zhang, Yan
    Huang, Yonghua
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2024, 90
  • [23] A Framework for Learning Dynamic Movement Primitives with Deep Reinforcement Learning
    Noohian, Amirhossein
    Raisi, Mehran
    Khodaygan, Saeed
    2022 10TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2022, : 329 - 334
  • [24] Robot Learning System Based on Adaptive Neural Control and Dynamic Movement Primitives
    Yang, Chenguang
    Chen, Chuize
    He, Wei
    Cui, Rongxin
    Li, Zhijun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (03) : 777 - 787
  • [25] Robot skill learning system of multi-space fusion based on dynamic movement primitives and adaptive neural network control
    Liu, Chengguo
    Peng, Guangzhu
    Xia, Yu
    Li, Junyang
    Yang, Chenguang
    NEUROCOMPUTING, 2024, 574
  • [26] The Generalization of Robot Skills Based on Dynamic Movement Primitives
    Li, Xian
    Yang, Chenguang
    Feng, Ying
    IFAC PAPERSONLINE, 2020, 53 (05): : 265 - 270
  • [27] Skill learning and action recognition by arc-length dynamic movement primitives
    Gaspar, Timotej
    Nemec, Bojan
    Morimoto, Jun
    Ude, Aleg
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2018, 100 : 225 - 235
  • [28] Gesture learning and execution in a humanoid robot via dynamic movement primitives
    Pfeiffer, Sammy
    Angulo, Cecilio
    PATTERN RECOGNITION LETTERS, 2015, 67 : 100 - 107
  • [29] Mobile Robot Path Planning Based on Dynamic Movement Primitives
    Jiang, Minghao
    Chen, Yang
    Zheng, Wenlei
    Wu, Huaiyu
    Cheng, Lei
    2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 980 - 985
  • [30] A Variable Impedance Skill Learning Algorithm Based on Kernelized Movement Primitives
    Liu, Andong
    Zhan, Shuwen
    Jin, Zhehao
    Zhang, Wen-An
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (01) : 870 - 879