DDETR-SLAM: A TRANSFORMER-BASED APPROACH TO POSE OPTIMISATION IN DYNAMIC ENVIRONMENTS

被引:0
|
作者
Li, Feng [1 ,2 ]
Liu, Yuanyuan [1 ]
Zhang, Kelong [2 ]
Hu, Zhengpeng [2 ]
Zhang, Guozheng [2 ]
机构
[1] Donghua Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Natl Innovat Ctr Adv Dyeing & Finishing Technol, Tai An 271000, Shandong, Peoples R China
来源
关键词
Simultaneous localisation and mapping; deformable DETR; object detection; dynamic environments;
D O I
10.2316/J.2024.206-1063
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) is a critical technology for accurate robot localisation and path planning. It has been an important area of research to improve localisation accuracy. In this paper, we propose a transformer-based visual semantic SLAM algorithm (DDETR-SLAM) to address the shortcomings of traditional visual SLAM frameworks, such as large localisation errors in dynamic scenes. First, by incorporating the deformable Detection Transformer (DETR) network as an object detection thread, the pose estimation accuracy of the system has been improved compared to ORB-SLAM2. Furthermore, an algorithm that combines the semantic information is designed to eliminate outlier points generated by dynamic objects, thereby improving the accuracy and robustness of SLAM localisation and mapping. Experiments are conducted on the public TUM datasets to verify the localisation accuracy, computational efficiency, and readability of the point cloud map of DDETR-SLAM. The results show that in highly dynamic environments, the absolute trajectory error (ATE), translation error, and rotation error are reduced by 98.45%, 95.34%, and 92.67%, respectively, when compared to ORB-SLAM2. In most cases, our proposed system outperforms DS-SLAM, DynaSLAM, Detect-SLAM, RGB-D SLAM, and YOLOv5+ORB-SLAM2. The relative pose error (RPE) is only 0.0076 m, the ATE is only 0.0063 m, and the dense mapping also has better readability.
引用
收藏
页码:407 / 421
页数:15
相关论文
共 50 条
  • [1] Model-based Dynamic Pose Graph SLAM in Unstructured Dynamic Environments
    Deeb, A.
    Seto, M. L.
    Pan, Y. J.
    [J]. 2019 19TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR), 2019, : 123 - 128
  • [2] Vision Transformer-based pilot pose estimation
    Wu, Honglan
    Liu, Hao
    Sun, Youchao
    [J]. Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (10): : 3100 - 3110
  • [3] Transformer-based rapid human pose estimation network
    Wang, Dong
    Xie, Wenjun
    Cai, Youcheng
    Li, Xinjie
    Liu, Xiaoping
    [J]. COMPUTERS & GRAPHICS-UK, 2023, 116 : 317 - 326
  • [4] AiPE: A Novel Transformer-Based Pose Estimation Method
    Lu, Kai
    Min, Dugki
    [J]. ELECTRONICS, 2024, 13 (05)
  • [5] Transformer-Based Approach to Melanoma Detection
    Cirrincione, Giansalvo
    Cannata, Sergio
    Cicceri, Giovanni
    Prinzi, Francesco
    Currieri, Tiziana
    Lovino, Marta
    Militello, Carmelo
    Pasero, Eros
    Vitabile, Salvatore
    [J]. SENSORS, 2023, 23 (12)
  • [6] Transformer-based approach to variable typing
    Rey, Charles Arthel
    Danguilan, Jose Lorenzo
    Mendoza, Karl Patrick
    Remolona, Miguel Francisco
    [J]. HELIYON, 2023, 9 (10)
  • [7] Dynamic Pose Graph SLAM: Long-term Mapping in Low Dynamic Environments
    Walcott-Bryant, Aisha
    Kaess, Michael
    Johannsson, Hordur
    Leonard, John J.
    [J]. 2012 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2012, : 1871 - 1878
  • [8] Transformer-based Dynamic Fusion Clustering Network
    Zhang, Chunchun
    Zhao, Yaliang
    Wang, Jinke
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [9] A Transformer-Based Network for Full Object Pose Estimation with Depth Refinement
    Abdulsalam, Mahmoud
    Ahiska, Kenan
    Aouf, Nabil
    [J]. ADVANCED INTELLIGENT SYSTEMS, 2024,
  • [10] A Sparse Transformer-Based Approach for Image Captioning
    Lei, Zhou
    Zhou, Congcong
    Chen, Shengbo
    Huang, Yiyong
    Liu, Xianrui
    [J]. IEEE ACCESS, 2020, 8 : 213437 - 213446