Leveraging the efficiency of multi-task robot manipulation via task-evoked planner and reinforcement learning

被引:1
|
作者
Qi, Haofu [1 ,2 ]
Zheng, Haoyang [1 ,2 ]
Shao, Jun [1 ,2 ]
Zhang, Jiatao [1 ,2 ]
Gu, Jason [2 ]
Song, Wei [1 ,2 ]
Zhu, Shiqiang [1 ]
机构
[1] Zhejiang Univ, Hangzhou 310030, Peoples R China
[2] Zhejiang Lab, Res Inst Interdisciplinary Innovat, Res Ctr Intelligent Robot, Hangzhou 311100, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICRA57147.2024.10611076
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-task learning has expanded the boundaries of robotic manipulation, enabling the execution of increasingly complex tasks. However, policies learned through reinforcement learning exhibit limited generalization and narrow distributions, which restrict their effectiveness in multi-task training. Addressing the challenge of obtaining policies with generalization and stability represents a non-trivial problem. To tackle this issue, we propose a planning-guided reinforcement learning method. It leverages a task-evoked planner(TEP) and a reinforcement learning approach with planner's guidance. TEP utilizes reusable samples as the source, with the aim of learning reachability information across different task scenarios. Then in reinforcement learning, TEP assesses and guides the Actor towards better outputs and smoothly enhances the performance in multi-task benchmarks. We evaluate this approach within the Meta-World framework and compare it with prior works in terms of learning efficiency and effectiveness. Depending on experimental results, our method has more efficiency, higher success rates, and demonstrates more realistic behavior.
引用
收藏
页码:9220 / 9226
页数:7
相关论文
共 50 条
  • [31] Multi-task gradient descent for multi-task learning
    Bai, Lu
    Ong, Yew-Soon
    He, Tiantian
    Gupta, Abhishek
    MEMETIC COMPUTING, 2020, 12 (04) : 355 - 369
  • [32] Space robotic manipulation: a multi-task learning perspective
    Li Linfeng
    Xie Yongchun
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2022, 42 (03) : 10 - 24
  • [33] Multi-Asset Market Making via Multi-Task Deep Reinforcement Learning
    Haider, Abbas
    Hawe, Glenn, I
    Wang, Hui
    Scotney, Bryan
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE (LOD 2021), PT II, 2022, 13164 : 353 - 364
  • [34] Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
    Oh, Junhyuk
    Singh, Satinder
    Lee, Honglak
    Kohli, Pushmeet
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [35] Optimization of Deep Reinforcement Learning with Hybrid Multi-Task Learning
    Varghese, Nelson Vithayathil
    Mahmoud, Qusay H.
    2021 15TH ANNUAL IEEE INTERNATIONAL SYSTEMS CONFERENCE (SYSCON 2021), 2021,
  • [36] Learning potential functions and their representations for multi-task reinforcement learning
    Matthijs Snel
    Shimon Whiteson
    Autonomous Agents and Multi-Agent Systems, 2014, 28 : 637 - 681
  • [37] Towards Robust Knowledge Graph Embedding via Multi-Task Reinforcement Learning
    Zhang, Zhao
    Zhuang, Fuzhen
    Zhu, Hengshu
    Li, Chao
    Xiong, Hui
    He, Qing
    Xu, Yongjun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 4321 - 4334
  • [38] Learning potential functions and their representations for multi-task reinforcement learning
    Snel, Matthijs
    Whiteson, Shimon
    AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2014, 28 (04) : 637 - 681
  • [39] Demonstration-Bootstrapped Autonomous Practicing via Multi-Task Reinforcement Learning
    Gupta, Abhishek
    Lynch, Corey
    Kinman, Brandon
    Peake, Garrett
    Levine, Sergey
    Hausman, Karol
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 5020 - 5026
  • [40] Multi-task Hierarchical Adversarial Inverse Reinforcement Learning
    Chen, Jiayu
    Tamboli, Dipesh
    Lan, Tian
    Aggarwal, Vaneet
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202