Cognitive Navigation for Intelligent Mobile Robots: A Learning-Based Approach with Topological Memory Configuration

被引:0
|
作者
Liu, Qiming [1 ]
Cui, Xinru [1 ]
Liu, Zhe [2 ]
Wang, Hesheng [3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, AI Inst, MoE Key Lab Artificial Intelligence, Shanghai 200240, Peoples R China
[3] Shanghai Jiao Tong Univ, Shanghai Engn Res Ctr Intelligent Control & Manage, Key Lab Marine Intelligent Equipment & Syst, Minist Educ,Dept Automat,Key Lab Syst Control & In, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural networks (GNNs); spatial memory; topological map; visual navigation; SLAM; NETWORK;
D O I
10.1109/JAS.2024.124332
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Autonomous navigation for intelligent mobile robots has gained significant attention, with a focus on enabling robots to generate reliable policies based on maintenance of spatial memory. In this paper, we propose a learning-based visual navigation pipeline that uses topological maps as memory configurations. We introduce a unique online topology construction approach that fuses odometry pose estimation and perceptual similarity estimation. This tackles the issues of topological node redundancy and incorrect edge connections, which stem from the distribution gap between the spatial and perceptual domains. Furthermore, we propose a differentiable graph extraction structure, the topology multi-factor transformer (TMFT). This structure utilizes graph neural networks to integrate global memory and incorporates a multi-factor attention mechanism to underscore elements closely related to relevant target cues for policy generation. Results from photorealistic simulations on image-goal navigation tasks highlight the superior navigation performance of our proposed pipeline compared to existing memory structures. Comprehensive validation through behavior visualization, interpretability tests, and real-world deployment further underscore the adaptability and efficacy of our method.
引用
收藏
页码:1933 / 1943
页数:11
相关论文
共 50 条
  • [1] Cognitive Navigation for Intelligent Mobile Robots:A Learning-Based Approach With Topological Memory Configuration
    Qiming Liu
    Xinru Cui
    Zhe Liu
    Hesheng Wang
    IEEE/CAAJournalofAutomaticaSinica, 2024, 11 (09) : 1933 - 1943
  • [2] Learning-based intelligent trajectory planning for auto navigation of magnetic robots
    Kou, Yuanshi
    Liu, Xurui
    Ma, Xiaotian
    Xiang, Yuanzhuo
    Zang, Jianfeng
    FRONTIERS IN ROBOTICS AND AI, 2023, 10
  • [3] Using learned visual landmarks for intelligent topological navigation of mobile robots
    Mata, M
    Armingol, JM
    de la Escalera, A
    Salichs, MA
    2003 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-3, PROCEEDINGS, 2003, : 1324 - 1329
  • [4] A Deep Learning-based Visual Perception Approach for Mobile Robots
    Shan, Guangcun
    Li, Xin
    Zhang, Yinan
    Wang, Tian
    Fang, Yinghong
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 825 - 829
  • [5] Deep Learning-Based Visual Navigation Algorithms for Mobile Robots: A Comprehensive Study
    Yu W.
    Tian X.
    Journal of Computing and Information Technology, 2022, 30 (04) : 257 - 273
  • [6] A Navigation System for Intelligent Mobile Robots
    Romanov, Alexey M.
    Romanov, Mikhail P.
    Morozov, Aleksandr A.
    Slepynina, Evgeniya A.
    PROCEEDINGS OF THE 2019 IEEE CONFERENCE OF RUSSIAN YOUNG RESEARCHERS IN ELECTRICAL AND ELECTRONIC ENGINEERING (EICONRUS), 2019, : 652 - 656
  • [7] Toward Intelligent Navigation for Autonomous Mobile Robots: Learning from the Classics
    Walid, Jebrane
    Nabil, El Akchioui
    ADVANCES IN CONTROL POWER SYSTEMS AND EMERGING TECHNOLOGIES, VOL 2, ICESA 2023, 2024, : 189 - 195
  • [8] Reinforcement learning-based mobile robot navigation
    Altuntas, Nihal
    Imal, Erkan
    Emanet, Nahit
    Ozturk, Ceyda Nur
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2016, 24 (03) : 1747 - 1767
  • [9] Topological navigation in configuration space applied to soccer robots
    Neto, G
    Costelha, H
    Lima, P
    ROBOCUP 2003: ROBOT SOCCER WORLD CUP VII, 2004, 3020 : 551 - 558
  • [10] Learning for intelligent mobile robots
    Hall, EL
    Liao, X
    Ali, SMA
    INTELLIGENT ROBOTS AND COMPUTER VISION XXI: ALGORITHMS, TECHNIQUES, AND ACTIVE VISION, 2003, 5267 : 12 - 25