Reinforcement Learning-based Learning from Demonstrations for Collaborative Robots

被引:1
|
作者
Li, W. D. [1 ]
机构
[1] Wuhan Univ Technol, Sch Logist Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CASE49439.2021.9551596
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Learning from Demonstrations (LfD) can support a human operator to control a collaborative robot (cobot) in an intuitive means. Gaussian Mixture Model and Gaussian Mixture Regression (GMM and GMR) are useful tools for implementing such a LfD approach. However, well-performed GMM/GMR require a series of demonstrations without trembling and jerky features, which is challenging to achieve in practical applications. To address this issue, in this paper, an improved Reinforcement Learning (RL)-based approach for GMM/GMR is devised to carry out a variety of complex tasks. The innovations of the research are twofold: firstly, a Gaussian noise strategy is designed to scatter demonstrations with trembling and jerky features to better support the optimization of GMM/GMR; Secondly, an improved RL-based optimization algorithm is developed to eliminate potential under-/over-fitting GMM/GMR. A cases study was conducted to verify the approach. Experimental results and comparative analyses showed that this developed approach exhibited good performances in computational efficiency and solution quality.
引用
收藏
页码:1642 / 1647
页数:6
相关论文
共 50 条
  • [1] Optimised Learning from Demonstrations for Collaborative Robots
    Wang, Y. Q.
    Hu, Y. D.
    El Zaatari, S.
    Li, W. D.
    Zhou, Y.
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2021, 71
  • [2] ACCELERATING TRAINING OF REINFORCEMENT LEARNING-BASED CONSTRUCTION ROBOTS IN SIMULATION USING DEMONSTRATIONS COLLECTED IN VIRTUAL REALITY
    Huang, Lei
    Zou, Zhengbo
    [J]. 2022 WINTER SIMULATION CONFERENCE (WSC), 2022, : 2451 - 2462
  • [3] A Reinforcement Learning-based Path Planning for Collaborative UAVs
    Rahim, Shahnila
    Razaq, Mian Muaz
    Chang, Shih Yu
    Peng, Limei
    [J]. 37TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, 2022, : 1938 - 1943
  • [4] Practical considerations in reinforcement learning-based MPC for mobile robots
    Busetto, Riccardo
    Breschi, Valentina
    Vaccari, Giulio
    Formentin, Simone
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 5787 - 5792
  • [5] Deep learning-based hand gesture recognition for collaborative robots
    Nuzzi, Cristina
    Pasinetti, Simone
    Lancini, Matteo
    Docchio, Franco
    Sansoni, Giovanna
    [J]. IEEE Instrumentation and Measurement Magazine, 2019, 22 (02): : 44 - 51
  • [6] Deep Learning-Based Hand Gesture Recognition for Collaborative Robots
    Nuzzi, Cristina
    Pasinetti, Simone
    Lancini, Matteo
    Docchio, Franco
    Sansoni, Giovanna
    [J]. IEEE INSTRUMENTATION & MEASUREMENT MAGAZINE, 2019, 22 (02) : 44 - 51
  • [7] From Robots to Reinforcement Learning
    Du, Tongchun
    Cox, Michael T.
    Perlis, Don
    Shamwell, Jared
    Oates, Tim
    [J]. 2013 IEEE 25TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2013, : 540 - 545
  • [8] Reinforcement learning-based motion control for snake robots in complex environments
    Zhang, Dong
    Ju, Renjie
    Cao, Zhengcai
    [J]. ROBOTICA, 2024, 42 (04) : 947 - 961
  • [9] Deep Reinforcement Learning-Based Control of Bicycle Robots on Rough Terrain
    Zhu, Xianjin
    Zheng, Xudong
    Deng, Yang
    Chen, Zhang
    Liang, Bin
    Liu, Yu
    [J]. 2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 103 - 108
  • [10] Learning Fairness from Demonstrations via Inverse Reinforcement Learning
    Blandin, Jack
    Kash, Ian
    [J]. PROCEEDINGS OF THE 2024 ACM CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, ACM FACCT 2024, 2024, : 51 - 61