A robotic shared control teleoperation method based on learning from demonstrations

被引:26
|
作者
Xi, Bao [1 ,2 ]
Wang, Shuo [1 ,2 ,3 ]
Ye, Xuemei [1 ]
Cai, Yinghao [1 ]
Lu, Tao [1 ]
Wang, Rui [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 101408, Peoples R China
[3] Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Techn, Shanghai, Peoples R China
来源
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Dual arm; hidden semi-Markov model; goal prediction; operation assistance; virtual reality; COMPLEX;
D O I
10.1177/1729881419857428
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In teleoperation, the operator is often required to command the motion of the remote robot and monitor its behavior. However, such an interaction demands a heavy workload from a human operator when facing with complex tasks and dynamic environments. In this article, we propose a shared control method to assist the operator in the manipulation tasks to reduce the workload and improve the efficiency. We adopt a task-parameterized hidden semi-Markov model to learn a manipulation skill from several human demonstrations. We utilize the learned model to predict the manipulation target given the current observed robotic motion trajectory and subsequently estimate the desired robotic motion given the current input of the operator. The estimated robotic motion is then utilized to correct the input of the operator to provide manipulation assistance. In addition, a set of virtual reality devices are used to capture the operator's motion and display the vision feedback from the remote site. We evaluate our approach through two manipulation tasks with a dual-arm robot. The experimental results show the effectiveness of the proposed method.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [1] Reinforcement Learning Based Shared Control: A Novel Teleoperation Strategy for Robotic
    Chang, Ziqing
    Cheng, Hao
    Ge, Hangli
    Duan, Feng
    [J]. 2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 527 - 532
  • [2] A Teleoperation Method Based on Posture Shared Control Strategy
    Wang, Xin
    Zhao, Jing
    Zhang, Ziqiang
    [J]. 2022 6TH INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS 2022), 2022, : 1 - 6
  • [3] A Muscle Teleoperation System of a Robotic Rollator Based on Bilateral Shared Control
    Chen, Dingping
    Zhou, Xuanyi
    Li, Jiehao
    He, Jilin
    Yu, Xiaopeng
    Zhang, Longbin
    Qi, Wen
    [J]. IEEE ACCESS, 2020, 8 : 151160 - 151170
  • [4] An EEG Based Dynamic Shared Control Method For Online Teleoperation
    Zhu, Guodong
    Zhang, Kaiming
    Liu, Shuang
    Qian, Bo
    Zhang, Xiancheng
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 1188 - 1193
  • [5] A Skill-Based Autonomous Control Method for Robotic Teleoperation
    Zang, Xizhe
    Zhao, Jie
    Cai, Hegao
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, PT I, PROCEEDINGS, 2008, 5314 : 679 - 688
  • [6] Shared Compliant Control of Teleoperation Based on Stiffness Feedback
    Chen, Yang
    Wang, Xuezhu
    [J]. MECHATRONICS AND INDUSTRIAL INFORMATICS, PTS 1-4, 2013, 321-324 : 1482 - +
  • [7] A Teleoperation Framework for Mobile Robots Based on Shared Control
    Luo, Jing
    Lin, Zhidong
    Li, Yanan
    Yang, Chenguang
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 377 - 384
  • [8] RoMaViD: Learning Robotic Manipulation from Video Demonstrations
    Upadhyay, Abhinav
    Dubey, Alpana
    Sengupta, Shubhashis
    [J]. PROCEEDINGS OF 2024 IEEE/ACM 6TH INTERNATIONAL WORKSHOP ON ROBOTICS SOFTWARE ENGINEERING, ROSE 2024, 2024, : 17 - 24
  • [9] Continuous Teleoperation of a Robotic Manipulator via Brain-Machine Interface with Shared Control
    Tortora, Stefano
    Gottardi, Alberto
    Menegatti, Emanuele
    Tonin, Luca
    [J]. 2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [10] Auxiliary Asymmetric Dual-user Shared Control Method for Teleoperation
    Huang, Panfeng
    Lu, Zhenyu
    [J]. 2015 12TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2015, : 267 - 272