Restored Action Generative Adversarial Imitation Learning from observation for robot manipulator

被引:0
|
作者
Park, Jongcheon [1 ]
Han, Seungyong [1 ]
Lee, S. M. [1 ]
机构
[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, Cyber Phys Syst & Control Lab, Daehak-ro 80, Daegu, South Korea
基金
新加坡国家研究基金会;
关键词
Imitation learning from observation; Manipulator; Restored Action Generative Adversarial; Imitation Learning;
D O I
10.1016/j.isatra.2022.02.041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a new imitation learning algorithm is proposed based on the Restored Action Generative Adversarial Imitation Learning (RAGAIL) from observation. An action policy is trained to move a robot manipulator similar to a demonstrator's behavior by using the restored action from stateonly demonstration. To imitate the demonstrator, the trajectory is generated by Recurrent Generative Adversarial Networks (RGAN), and the action is restored from the output of the tracking controller constructed by the state and the generated target trajectory. The proposed imitation learning algorithm is not required to access the demonstrator's action (internal control signal such as force/torque command) and provides better learning performances. The effectiveness of the proposed method is validated through the experimental results of the robot manipulator.(c) 2022 ISA. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:684 / 690
页数:7
相关论文
共 50 条
  • [1] Robot Manipulation Learning Using Generative Adversarial Imitation Learning
    Jabri, Mohamed Khalil
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4893 - 4894
  • [2] Generative Adversarial Imitation Learning
    Ho, Jonathan
    Ermon, Stefano
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [3] Generative Adversarial Imitation Learning from Failed Experiences
    Zhu, Jiacheng
    Lin, Jiahao
    Wang, Meng
    Chen, Yingfeng
    Fan, Changjie
    Jiang, Chong
    Zhang, Zongzhang
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13997 - 13998
  • [4] Quantum generative adversarial imitation learning
    Xiao, Tailong
    Huang, Jingzheng
    Li, Hongjing
    Fan, Jianping
    Zeng, Guihua
    [J]. NEW JOURNAL OF PHYSICS, 2023, 25 (03):
  • [5] Deterministic generative adversarial imitation learning
    Zuo, Guoyu
    Chen, Kexin
    Lu, Jiahao
    Huang, Xiangsheng
    [J]. NEUROCOMPUTING, 2020, 388 : 60 - 69
  • [6] Collaborative Robot-Assisted Endovascular Catheterization with Generative Adversarial Imitation Learning
    Chi, Wenqiang
    Dagnino, Giulio
    Kwok, Trevor M. Y.
    Anh Nguyen
    Kundrat, Dennis
    Abdelaziz, Mohamed E. M. K.
    Riga, Celia
    Bicknell, Colin
    Yang, Guang-Zhong
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 2414 - 2420
  • [7] Generative Adversarial Network for Imitation Learning from Single Demonstration
    Tho Nguyen Duc
    Chanh Minh Tran
    Phan Xuan Tan
    Kamioka, Eiji
    [J]. BAGHDAD SCIENCE JOURNAL, 2021, 18 (04) : 1350 - 1355
  • [8] A Bayesian Approach to Generative Adversarial Imitation Learning
    Jeon, Wonseok
    Seo, Seokin
    Kim, Kee-Eung
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [9] A Survey of Imitation Learning Based on Generative Adversarial Nets
    Lin J.-H.
    Zhang Z.-Z.
    Jiang C.
    Hao J.-Y.
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2020, 43 (02): : 326 - 351
  • [10] Ranking-Based Generative Adversarial Imitation Learning
    Shi, Zhipeng
    Zhang, Xuehe
    Fang, Yu
    Li, Changle
    Liu, Gangfeng
    Zhao, Jie
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (10): : 8967 - 8974