A Survey of Embodied AI: From Simulators to Research Tasks

被引:101
|
作者
Duan, Jiafei [1 ]
Yu, Samson [2 ]
Tan, Hui Li [3 ]
Zhu, Hongyuan [3 ]
Tan, Cheston [3 ]
机构
[1] Nanyang Technol Univ Singapore, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Singapore Univ Technol & Design, Singapore 487372, Singapore
[3] ASTAR, Inst Infocomm Res, Singapore 138632, Singapore
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2022年 / 6卷 / 02期
基金
新加坡国家研究基金会;
关键词
Artificial intelligence; Task analysis; Navigation; Physics; Three-dimensional displays; Visualization; Solid modeling; Embodied AI; computer vision; 3D simulators; NAVIGATION;
D O I
10.1109/TETCI.2022.3141105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been an emerging paradigm shift from the era of "internet AI" to "embodied AI," where AI algorithms and agents no longer learn from datasets of images, videos or text curated primarily from the internet. Instead, they learn through interactions with their environments from an egocentric perception similar to humans. Consequently, there has been substantial growth in the demand for embodied AI simulators to support various embodied AI research tasks. This growing interest in embodied AI is beneficial to the greater pursuit of Artificial General Intelligence (AGI), but there has not been a contemporary and comprehensive survey of this field. This paper aims to provide an encyclopedic survey for the field of embodied AI, from its simulators to its research. By evaluating nine current embodied AI simulators with our proposed seven features, this paper aims to understand the simulators in their provision for use in embodied AI research and their limitations. Lastly, this paper surveys the three main research tasks in embodied AI - visual exploration, visual navigation and embodied question answering (QA), covering the state-of-the-art approaches, evaluation metrics and datasets. Finally, with the new insights revealed through surveying the field, the paper will provide suggestions for simulator-for-task selections and recommendations for the future directions of the field.
引用
收藏
页码:230 / 244
页数:15
相关论文
共 50 条
  • [1] A survey of visual navigation: From geometry to embodied AI
    Zhang, Tianyao
    Hu, Xiaoguang
    Xiao, Jin
    Zhang, Guofeng
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
  • [2] From screens to scenes: A survey of embodied AI in healthcare
    Liu, Yihao
    Cao, Xu
    Chen, Tingting
    Jiang, Yankai
    You, Junjie
    Wu, Minghua
    Wang, Xiaosong
    Feng, Mengling
    Jin, Yaochu
    Chen, Jintai
    INFORMATION FUSION, 2025, 119
  • [3] Scene Augmentation Methods for Interactive Embodied AI Tasks
    Sang, Hongrui
    Jiang, Rong
    Wang, Zhipeng
    Zhou, Yanmin
    Lu, Ping
    He, Bin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [4] Habitat: A Platform for Embodied AI Research
    Savva, Manolis
    Kadian, Abhishek
    Maksymets, Oleksandr
    Zhao, Yili
    Wijmans, Erik
    Jain, Bhavana
    Straub, Julian
    Liu, Jia
    Koltun, Vladlen
    Malik, Jitendra
    Parikh, Devi
    Batra, Dhruv
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9338 - 9346
  • [5] Embodied navigation with multi-modal information: A survey from tasks to methodology
    Wu, Yuchen
    Zhang, Pengcheng
    Gu, Meiying
    Zheng, Jin
    Bai, Xiao
    INFORMATION FUSION, 2024, 112
  • [6] Reconfigurability, Why It Matters in AI Tasks Processing: A Survey of Reconfigurable AI Chips
    Wei, Shaojun
    Lin, Xinhan
    Tu, Fengbin
    Wang, Yang
    Liu, Leibo
    Yin, Shouyi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (03) : 1228 - 1241
  • [7] EDDIE: An Embodied AI System for Research and Intervention for Individuals with ASD
    Selkowitz, Robert
    Rodgers, Jonathan
    Moskal, P. J.
    Mrowczynski, Jon
    Colson, Christine
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 4385 - 4386
  • [8] Embodied AI beyond Embodied Cognition and Enactivism
    Manzotti, Riccardo
    PHILOSOPHIES, 2019, 4 (03)
  • [9] Removing some 'A' from AI: Embodied cultured networks
    Bakkum, DJ
    Shkolnik, AC
    Ben-Ary, G
    Gamblen, P
    DeMarse, TB
    Potter, SM
    EMBODIED ARTIFICIAL INTELLIGENCE, 2004, 3139 : 130 - 145
  • [10] A survey on network simulators, emulators, and testbeds used for research and education
    Gomez, Jose
    Kfoury, Elie F.
    Crichigno, Jorge
    Srivastava, Gautam
    COMPUTER NETWORKS, 2023, 237