A Model for Verifiable Grounding and Execution of Complex Natural Language Instructions

被引：0
|
作者：
Boteanu, Adrian [1 ]
Howard, Thomas [2 ]
Arkin, Jacob [2 ]
Kress-Gazit, Hadas [1 ]
机构：
[1] Cornell Univ, Sibley Sch Mech & Aerosp Engn, Ithaca, NY 14853 USA
[2] Univ Rochester, Hajim Sch Engn & Appl Sci, 601 Elmwood Ave, Rochester, NY 14627 USA
来源：
2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016) | 2016年
基金：
美国国家科学基金会;
关键词：
SCHEMAS;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Current methods of grounding natural language instructions do not include reactive or temporal components, making these methods unsuitable for instructions describing tasks as sets of conditional instructions. We introduce the Verifiable Distributed Correspondence Graph (V-DCG) model, which enables the validation of natural language instructions by using Linear Temporal Logic (LTL) specifications together with physical world groundings. We demonstrate the V-DCG model on a physical robot and provide examples of the output our system produces for natural language instructions.
引用
收藏
页码：2649 / 2654
页数：6
相关论文
共 50 条
  • [1] Differentiable Parsing and Visual Grounding of Natural Language Instructions for Object Placement
    Zhao, Zirui
    Lee, Wee Sun
    Hsu, David
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 11546 - 11553
  • [2] Grounding natural language instructions to semantic goal representations for abstraction and generalization
    Dilip Arumugam
    Siddharth Karamcheti
    Nakul Gopalan
    Edward C. Williams
    Mina Rhee
    Lawson L. S. Wong
    Stefanie Tellex
    Autonomous Robots, 2019, 43 : 449 - 468
  • [3] Grounding natural language instructions to semantic goal representations for abstraction and generalization
    Arumugam, Dilip
    Karamcheti, Siddharth
    Gopalan, Nakul
    Williams, Edward C.
    Rhee, Mina
    Wong, Lawson L. S.
    Tellex, Stefanie
    AUTONOMOUS ROBOTS, 2019, 43 (02) : 449 - 468
  • [4] Tell me Dave: Context-sensitive grounding of natural language to manipulation instructions
    Misra, Dipendra K.
    Sung, Jaeyong
    Lee, Kevin
    Saxena, Ashutosh
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (1-3): : 281 - 300
  • [5] Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environments
    Liu, Jason Xinyu
    Yang, Ziyi
    Idrees, Ifrah
    Liang, Sam
    Schornstein, Benjamin
    Tellex, Stefanie
    Shah, Ankit
    CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229
  • [6] Model-based test execution from high-level natural language instructions using GPT-4
    Azimi, Mohammad Yusaf
    Yilmaz, Cemal
    SOFTWARE QUALITY JOURNAL, 2025, 33 (01)
  • [7] Evaluation of Word Representations in Grounding Natural Language Instructions through Computational Human-Robot Interaction
    Roesler, Oliver
    Aly, Amir
    Taniguchi, Tadahiro
    Hayashi, Yoshikatsu
    HRI '19: 2019 14TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2019, : 307 - 316
  • [8] Robot Plan Model Generation and Execution with Natural Language Interface
    Yang, Kyon-Mo
    Seo, Kap-Ho
    Kang, Sang Hoon
    Lim, Yoonseob
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6973 - 6978
  • [9] Pragmatic overloading in natural language instructions
    DiEugenio, B
    Webber, BL
    INTERNATIONAL JOURNAL OF EXPERT SYSTEMS, 1996, 9 (01): : 53 - 84
  • [10] Verifiable source code documentation in controlled natural language
    Kuhn, Tobias
    Bergel, Alexandre
    SCIENCE OF COMPUTER PROGRAMMING, 2014, 96 : 121 - 140
12345