FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

被引:2
|
作者
Zhang, Jiatao [1 ,2 ]
Tang, Lanling [2 ,3 ]
Song, Yufan [1 ]
Menge, Qiwei [2 ]
Qian, Haofu [1 ,2 ]
Shao, Jun [1 ,2 ]
Song, Wei [1 ,2 ]
Zhu, Shiqiang [1 ]
Gu, Jason [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Zhejiang Lab, Res Ctr Intelligent Robot, Hangzhou, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICRA57147.2024.10611663
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent planning methods based on Large Language Models typically employ the In-Context Learning paradigm. Complex long-horizon planning tasks require more context(including instructions and demonstrations) to guarantee that the generated plan can be executed correctly. However, in such conditions, LLMs may overlook(unfaithful) the rules in the given context, resulting in the generated plans being invalid or even leading to dangerous actions. In this paper, we investigate the faithfulness of LLMs for complex long-horizon tasks. Inspired by human intelligence, we introduce a novel framework named FLTRNN. FLTRNN employs a language-based RNN structure to integrate task decomposition and memory management into LLM planning inference, which could effectively improve the faithfulness of LLMs and make the planner more reliable. We conducted experiments in VirtualHome household tasks. Results show that our model significantly improves faithfulness and success rates for complex long-horizon tasks. Website at https://tannl.github.io/FLTRNN.github.io/
引用
收藏
页码:6680 / 6686
页数:7
相关论文
共 50 条
  • [1] FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models
    Song, Wei (songweizju@163.com), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [2] Enhancement of long-horizon task planning via active and passive modification in large language models
    Hori, Kazuki
    Suzuki, Kanata
    Ogata, Tetsuya
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [3] Robust Task and Motion Planning for Long-Horizon Architectural Construction Planning
    Hartmann, Valentin N.
    Oguz, Ozgur S.
    Driess, Danny
    Toussaint, Marc
    Menges, Achim
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 6886 - 6893
  • [4] Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models
    Stepputtis, Simon
    Campbell, Joseph
    Xie, Yaqi
    Qi, Zhengyang
    Zhang, Wenxin Sharon
    Wang, Ruiyi
    Rangreji, Sanketh
    Lewis, Charles Michael
    Sycara, Katia P.
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 11193 - 11208
  • [5] Learning to Correct Mistakes: Backjumping in Long-Horizon Task and Motion Planning
    Sung, Yoonchang
    Wang, Zizhao
    Stone, Peter
    CONFERENCE ON ROBOT LEARNING, VOL 205, 2022, 205 : 2115 - 2124
  • [6] Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Models
    Mishra, Utkarsh A.
    Xue, Shangjie
    Chen, Yongxin
    Xu, Danfei
    CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229
  • [7] A Backbone for Long-Horizon Robot Task Understanding
    Chen, Xiaoshuai
    Chen, Wei
    Lee, Dongmyoung
    Ge, Yukun
    Rojas, Nicolas
    Kormushev, Petar
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02): : 2048 - 2055
  • [8] Long-Horizon Manipulation of Unknown Objects via Task and Motion Planning with Estimated Affordances
    Curtis, Aidan
    Fang, Xiaolin
    Kaelbling, Leslie Pack
    Lozano-Perez, Tomas
    Garrett, Caelan Reed
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 1940 - 1946
  • [9] Collaborative foresight: Complementing long-horizon strategic planning
    Weigand, Kirk
    Flanagan, Thomas
    Dye, Kevin
    Jones, Peter
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2014, 85 : 134 - 152
  • [10] Long-Horizon Informative Path Planning with Obstacles and Time Constraints
    Ge, Yaolin
    Olaisen, Andre Julius Hovd
    Eidsvik, Jo
    Jain, R. Praveen
    Johansen, Tor Arne
    IFAC PAPERSONLINE, 2022, 55 (31): : 124 - 129