FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

被引:2
|
作者
Zhang, Jiatao [1 ,2 ]
Tang, Lanling [2 ,3 ]
Song, Yufan [1 ]
Menge, Qiwei [2 ]
Qian, Haofu [1 ,2 ]
Shao, Jun [1 ,2 ]
Song, Wei [1 ,2 ]
Zhu, Shiqiang [1 ]
Gu, Jason [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Zhejiang Lab, Res Ctr Intelligent Robot, Hangzhou, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICRA57147.2024.10611663
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent planning methods based on Large Language Models typically employ the In-Context Learning paradigm. Complex long-horizon planning tasks require more context(including instructions and demonstrations) to guarantee that the generated plan can be executed correctly. However, in such conditions, LLMs may overlook(unfaithful) the rules in the given context, resulting in the generated plans being invalid or even leading to dangerous actions. In this paper, we investigate the faithfulness of LLMs for complex long-horizon tasks. Inspired by human intelligence, we introduce a novel framework named FLTRNN. FLTRNN employs a language-based RNN structure to integrate task decomposition and memory management into LLM planning inference, which could effectively improve the faithfulness of LLMs and make the planner more reliable. We conducted experiments in VirtualHome household tasks. Results show that our model significantly improves faithfulness and success rates for complex long-horizon tasks. Website at https://tannl.github.io/FLTRNN.github.io/
引用
收藏
页码:6680 / 6686
页数:7
相关论文
共 50 条
  • [21] Large language models for chemistry robotics
    Yoshikawa, Naruki
    Skreta, Marta
    Darvish, Kourosh
    Arellano-Rubach, Sebastian
    Ji, Zhi
    Kristensen, Lasse Bjorn
    Li, Andrew Zou
    Zhao, Yuchi
    Xu, Haoping
    Kuramshin, Artur
    Aspuru-Guzik, Alan
    Shkurti, Florian
    Garg, Animesh
    AUTONOMOUS ROBOTS, 2023, 47 (08) : 1057 - 1086
  • [22] Hierarchical reinforcement learning method for long-horizon path planning of stratospheric airship
    Lv, Chao
    Zhu, Ming
    Guo, Xiao
    Ou, Jiajun
    Lou, Wenjie
    AEROSPACE SCIENCE AND TECHNOLOGY, 2025, 160
  • [23] One Step at a Time: Long-Horizon Vision-and-Language Navigation with Milestones
    Song, Chan Hee
    Kil, Jihyung
    Pan, Tai-Yu
    Sadler, Brian M.
    Chao, Wei-Lun
    Su, Yu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15461 - 15470
  • [24] Long-Horizon Vehicle Planning and Control Through Real-Time Iterations
    Fors, Victor
    Gerdes, J. Christian
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [25] Long-horizon humanoid navigation planning using traversability estimates and previous experience
    Yu-Chi Lin
    Dmitry Berenson
    Autonomous Robots, 2021, 45 : 937 - 956
  • [26] Long-horizon humanoid navigation planning using traversability estimates and previous experience
    Lin, Yu-Chi
    Berenson, Dmitry
    AUTONOMOUS ROBOTS, 2021, 45 (06) : 937 - 956
  • [27] Knowledge Augmentation and Task Planning in Large Language Models for Dexterous Grasping
    Li, Hui
    Tran, Dang
    Zhang, Xinyu
    He, Hongsheng
    2023 IEEE-RAS 22ND INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS, HUMANOIDS, 2023,
  • [28] Task-Driven Reinforcement Learning With Action Primitives for Long-Horizon Manipulation Skills
    Wang, Hao
    Zhang, Hao
    Li, Lin
    Kan, Zhen
    Song, Yongduan
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (08) : 4513 - 4526
  • [29] Context-faithful Prompting for Large Language Models
    Zhou, Wenxuan
    Zhang, Sheng
    Poon, Hoifung
    Chen, Muhao
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 14544 - 14556
  • [30] Mixline: A Hybrid Reinforcement Learning Framework for Long-Horizon Bimanual Coffee Stirring Task
    Sun, Zheng
    Wang, Zhiqi
    Liu, Junjia
    Li, Miao
    Chen, Fei
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT I, 2022, 13455 : 627 - 636