Embodied intelligence in manufacturing: leveraging large language models for autonomous industrial robotics

被引:5
|
作者
Fan, Haolin [1 ]
Liu, Xuan [1 ]
Fuh, Jerry Ying Hsi [1 ]
Lu, Wen Feng [1 ]
Li, Bingbing [1 ,2 ]
机构
[1] Natl Univ Singapore, Dept Mech Engn, 9 Engn Dr 1, Singapore City 117575, Singapore
[2] Calif State Univ Northridge, Dept Mfg Syst Engn & Management, Northridge, CA 91330 USA
关键词
Large language models (LLMs) agents; Industrial robotics; Autonomous design; Decision-making; Embodied intelligence;
D O I
10.1007/s10845-023-02294-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper delves into the potential of Large Language Model (LLM) agents for industrial robotics, with an emphasis on autonomous design, decision-making, and task execution within manufacturing contexts. We propose a comprehensive framework that includes three core components: (1) matches manufacturing tasks with process parameters, emphasizing the challenges in LLM agents' understanding of human-imposed constraints; (2) autonomously designs tool paths, highlighting the LLM agents' proficiency in planar tasks and challenges in 3D spatial tasks; and (3) integrates embodied intelligence within industrial robotics simulations, showcasing the adaptability of LLM agents like GPT-4. Our experimental results underscore the distinctive performance of the GPT-4 agent, especially in Component 3, where it is outstanding in task planning and achieved a success rate of 81.88% across 10 samples in task completion. In conclusion, our study accentuates the transformative potential of LLM agents in industrial robotics and suggests specific avenues, such as visual semantic control and real-time feedback loops, for their enhancement.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Application of Pretrained Large Language Models in Embodied Artificial Intelligence
    A. K. Kovalev
    A. I. Panov
    [J]. Doklady Mathematics, 2022, 106 : S85 - S90
  • [2] Application of Pretrained Large Language Models in Embodied Artificial Intelligence
    Kovalev, A. K.
    Panov, A. I.
    [J]. DOKLADY MATHEMATICS, 2022, 106 (SUPPL 1) : S85 - S90
  • [3] Leveraging foundation and large language models in medical artificial intelligence
    Wong Io Nam
    Monteiro Olivia
    BaptistaHon Daniel T
    Wang Kai
    Lu Wenyang
    Sun Zhuo
    Nie Sheng
    Yin Yun
    [J]. 中华医学杂志英文版., 2024, 137 (21)
  • [4] Large language models for chemistry robotics
    Naruki Yoshikawa
    Marta Skreta
    Kourosh Darvish
    Sebastian Arellano-Rubach
    Zhi Ji
    Lasse Bjørn Kristensen
    Andrew Zou Li
    Yuchi Zhao
    Haoping Xu
    Artur Kuramshin
    Alán Aspuru-Guzik
    Florian Shkurti
    Animesh Garg
    [J]. Autonomous Robots, 2023, 47 : 1057 - 1086
  • [5] Large language models for chemistry robotics
    Yoshikawa, Naruki
    Skreta, Marta
    Darvish, Kourosh
    Arellano-Rubach, Sebastian
    Ji, Zhi
    Kristensen, Lasse Bjorn
    Li, Andrew Zou
    Zhao, Yuchi
    Xu, Haoping
    Kuramshin, Artur
    Aspuru-Guzik, Alan
    Shkurti, Florian
    Garg, Animesh
    [J]. AUTONOMOUS ROBOTS, 2023, 47 (08) : 1057 - 1086
  • [6] Leveraging large language models in dermatology
    Matin, Rubeta N.
    Linos, Eleni
    Rajan, Neil
    [J]. BRITISH JOURNAL OF DERMATOLOGY, 2023, 189 (03) : 253 - 254
  • [7] Applying Large Language Models for intelligent industrial automation From theory to application: Towards autonomous systems with Large Language Models
    Xia, Yuchen
    Jazdi, Nasser
    Weyrich, Michael
    [J]. ATP MAGAZINE, 2024, (6-7):
  • [8] Embodied human language models vs. Large Language Models, or why Artificial Intelligence cannot explain the modal be able to
    Torres-Martinez, Sergio
    [J]. BIOSEMIOTICS, 2024, 17 (01) : 185 - 209
  • [9] Embodied human language models vs. Large Language Models, or why Artificial Intelligence cannot explain the modal be able to
    Sergio Torres-Martínez
    [J]. Biosemiotics, 2024, 17 : 185 - 209
  • [10] Leveraging large language models for predictive chemistry
    Kevin Maik Jablonka
    Philippe Schwaller
    Andres Ortega-Guerrero
    Berend Smit
    [J]. Nature Machine Intelligence, 2024, 6 : 161 - 169