DDETR-SLAM: A TRANSFORMER-BASED APPROACH TO POSE OPTIMISATION IN DYNAMIC ENVIRONMENTS

被引:0
|
作者
Li, Feng [1 ,2 ]
Liu, Yuanyuan [1 ]
Zhang, Kelong [2 ]
Hu, Zhengpeng [2 ]
Zhang, Guozheng [2 ]
机构
[1] Donghua Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Natl Innovat Ctr Adv Dyeing & Finishing Technol, Tai An 271000, Shandong, Peoples R China
来源
关键词
Simultaneous localisation and mapping; deformable DETR; object detection; dynamic environments;
D O I
10.2316/J.2024.206-1063
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) is a critical technology for accurate robot localisation and path planning. It has been an important area of research to improve localisation accuracy. In this paper, we propose a transformer-based visual semantic SLAM algorithm (DDETR-SLAM) to address the shortcomings of traditional visual SLAM frameworks, such as large localisation errors in dynamic scenes. First, by incorporating the deformable Detection Transformer (DETR) network as an object detection thread, the pose estimation accuracy of the system has been improved compared to ORB-SLAM2. Furthermore, an algorithm that combines the semantic information is designed to eliminate outlier points generated by dynamic objects, thereby improving the accuracy and robustness of SLAM localisation and mapping. Experiments are conducted on the public TUM datasets to verify the localisation accuracy, computational efficiency, and readability of the point cloud map of DDETR-SLAM. The results show that in highly dynamic environments, the absolute trajectory error (ATE), translation error, and rotation error are reduced by 98.45%, 95.34%, and 92.67%, respectively, when compared to ORB-SLAM2. In most cases, our proposed system outperforms DS-SLAM, DynaSLAM, Detect-SLAM, RGB-D SLAM, and YOLOv5+ORB-SLAM2. The relative pose error (RPE) is only 0.0076 m, the ATE is only 0.0063 m, and the dense mapping also has better readability.
引用
下载
收藏
页码:407 / 421
页数:15
相关论文
共 50 条
  • [31] Sensor Fusion-Based Approach to Eliminating Moving Objects for SLAM in Dynamic Environments
    Dang, Xiangwei
    Rong, Zheng
    Liang, Xingdong
    SENSORS, 2021, 21 (01) : 1 - 24
  • [32] Transformer-based models to deal with heterogeneous environments in Human Activity Recognition
    Ek S.
    Portet F.
    Lalanda P.
    Personal and Ubiquitous Computing, 2023, 27 (06) : 2267 - 2280
  • [33] A Transformer-Based Signal Denoising Network for AoA Estimation in NLoS Environments
    Liu, Junchen
    Wang, Tianyu
    Li, Yuxiao
    Li, Cheng
    Wang, Yi
    Shen, Yuan
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (10) : 2336 - 2339
  • [34] Transformer-based travel time estimation method for plateau and mountainous environments
    Guangjun Qu
    Kefa Zhou
    Rui Wang
    Dong Li
    Yingpeng Lu
    Zhihong Lv
    Dequan Zhao
    Aijun Zhang
    Qing Zhang
    Scientific Reports, 15 (1)
  • [35] Visual SLAM in dynamic environments based on object detection
    Yong-bao Ai
    Ting Rui
    Xiao-qiang Yang
    Jia-lin He
    Lei Fu
    Jian-bin Li
    Ming Lu
    Defence Technology, 2021, (05) : 1712 - 1721
  • [36] Visual SLAM in dynamic environments based on object detection
    Ai Y.-B.
    Rui T.
    Yang X.-Q.
    He J.-L.
    Fu L.
    Li J.-B.
    Lu M.
    Defence Technology, 2021, 17 (05): : 1712 - 1721
  • [37] Visual SLAM in dynamic environments based on object detection
    Ai, Yong-bao
    Rui, Ting
    Yang, Xiao-qiang
    He, Jia-lin
    Fu, Lei
    Li, Jian-bin
    Lu, Ming
    DEFENCE TECHNOLOGY, 2021, 17 (05) : 1712 - 1721
  • [38] Visual SLAM in dynamic environments based on object detection
    Yongbao Ai
    Ting Rui
    Xiaoqiang Yang
    Jialin He
    Lei Fu
    Jianbin Li
    Ming Lu
    Defence Technology, 2021, 17 (05) : 1712 - 1721
  • [39] Pruning-guided feature distillation for an efficient transformer-based pose estimation model
    Kim, Dong-hwi
    Lee, Dong-hun
    Kim, Aro
    Jeong, Jinwoo
    Lee, Jong Taek
    Kim, Sungjei
    Park, Sang-hyo
    IET COMPUTER VISION, 2024, 18 (06) : 745 - 758
  • [40] Transformer-based 3D Human pose estimation and action achievement evaluation
    Yang, Aolei
    Zhou, Yinghong
    Yang, Banghua
    Xu, Yulin
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2024, 45 (04): : 136 - 144