Adaptive Impedance Control of Human-Robot Cooperation Using Reinforcement Learning

被引:108
|
作者
Li, Zhijun [1 ,2 ,3 ]
Liu, Junqiang [1 ]
Huang, Zhicong [1 ]
Peng, Yan [4 ]
Pu, Huayan [4 ]
Ding, Liang [5 ]
机构
[1] South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510630, Guangdong, Peoples R China
[2] Univ Sci & Technol China, Dept Automat, Hefei 230022, Anhui, Peoples R China
[3] Harbin Inst Technol, State Key Lab Robot & Syst, Harbin 150001, Heilongjiang, Peoples R China
[4] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai 200444, Peoples R China
[5] Harbin Inst Technol, Res Inst Intelligent Control & Syst, Sch Astronaut, Harbin 150001, Heilongjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive impedance control; barrier Lyapunov function (BLF); human-robot cooperation (HRC); integral reinforcement learning (IRL); linear quadratic regulation (LQR); NONLINEAR-SYSTEMS;
D O I
10.1109/TIE.2017.2694391
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents human-robot cooperation with adaptive behavior of the robot, which helps the human operator to perform the cooperative task and optimizes its performance. A novel adaptive impedance control is proposed for the roboticmanipulator, whose end-effector's motions are constrained by human arm motion limits. In order to minimized motion tracking errors and acquire an optimal impedance mode of human arms, the linear quadratic regulation (LQR) is formulated; then, integral reinforcement learning (IRL) has been proposed to solve the given LQR with little information of the human arm model. Considering human-robot interaction force during the robot performing manipulation, a novel barrier-Lyapunov-function-based adaptive impedance control incorporating adaptive parameter learning is developed for physical limits, transient perturbations, and time-varying dynamics. Experimental results validate that the proposed controller is effective in assisting the operator to perform the human-robot cooperative task.
引用
收藏
页码:8013 / 8022
页数:10
相关论文
共 50 条
  • [1] Iterative Learning of Variable Impedance Control for Human-Robot Cooperation
    Yamawaki, Tasuku
    Ishikawa, Hiroki
    Yashima, Masahito
    [J]. 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), 2016, : 839 - 844
  • [2] Impedance Learning-Based Adaptive Control for Human-Robot Interaction
    Sharifi, Mojtaba
    Azimi, Vahid
    Mushahwar, Vivian K.
    Tavakoli, Mahdi
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2022, 30 (04) : 1345 - 1358
  • [3] Human-Adaptive Impedance Control Using Recurrent Neural Network for Stability Recovery in Human-Robot Cooperation
    Hanafusa, Misaki
    Ishikawa, Jun
    [J]. 2020 IEEE 16TH INTERNATIONAL WORKSHOP ON ADVANCED MOTION CONTROL (AMC), 2020, : 265 - 272
  • [4] Shared Impedance Control Based on Reinforcement Learning in a Human-Robot Collaboration Task
    Wu, Min
    He, Yanhao
    Liu, Steven
    [J]. ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, 2020, 980 : 95 - 103
  • [5] Reinforcement learning for human-robot shared control
    Li, Yanan
    Tee, Keng Peng
    Yan, Rui
    Ge, Shuzhi Sam
    [J]. ASSEMBLY AUTOMATION, 2020, 40 (01) : 105 - 117
  • [6] Human-robot force cooperation analysis by deep reinforcement learning
    Li, Shaodong
    Yuan, Xiaogang
    Yu, Hongjian
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2023, 50 (02): : 287 - 298
  • [7] Adaptive Gain Control for a Steady Human-Robot Cooperation
    Lin, Hsien-, I
    Ho, Yu-Cheng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER PHYSICAL SYSTEMS (ICPS 2019), 2019, : 325 - 330
  • [8] Variable impedance control with stiffness for human-robot cooperation system
    Bae, Jangho
    Ko, JongHyeon
    Hong, Daehie
    [J]. 2015 15TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2015, : 1231 - 1233
  • [9] Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration
    Roveda, Loris
    Maskani, Jeyhoon
    Franceschi, Paolo
    Abdi, Arash
    Braghin, Francesco
    Tosatti, Lorenzo Molinari
    Pedrocchi, Nicola
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 100 (02) : 417 - 433
  • [10] Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration
    Loris Roveda
    Jeyhoon Maskani
    Paolo Franceschi
    Arash Abdi
    Francesco Braghin
    Lorenzo Molinari Tosatti
    Nicola Pedrocchi
    [J]. Journal of Intelligent & Robotic Systems, 2020, 100 : 417 - 433