DDETR-SLAM: A TRANSFORMER-BASED APPROACH TO POSE OPTIMISATION IN DYNAMIC ENVIRONMENTS

被引:0
|
作者
Li, Feng [1 ,2 ]
Liu, Yuanyuan [1 ]
Zhang, Kelong [2 ]
Hu, Zhengpeng [2 ]
Zhang, Guozheng [2 ]
机构
[1] Donghua Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] Natl Innovat Ctr Adv Dyeing & Finishing Technol, Tai An 271000, Shandong, Peoples R China
来源
关键词
Simultaneous localisation and mapping; deformable DETR; object detection; dynamic environments;
D O I
10.2316/J.2024.206-1063
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) is a critical technology for accurate robot localisation and path planning. It has been an important area of research to improve localisation accuracy. In this paper, we propose a transformer-based visual semantic SLAM algorithm (DDETR-SLAM) to address the shortcomings of traditional visual SLAM frameworks, such as large localisation errors in dynamic scenes. First, by incorporating the deformable Detection Transformer (DETR) network as an object detection thread, the pose estimation accuracy of the system has been improved compared to ORB-SLAM2. Furthermore, an algorithm that combines the semantic information is designed to eliminate outlier points generated by dynamic objects, thereby improving the accuracy and robustness of SLAM localisation and mapping. Experiments are conducted on the public TUM datasets to verify the localisation accuracy, computational efficiency, and readability of the point cloud map of DDETR-SLAM. The results show that in highly dynamic environments, the absolute trajectory error (ATE), translation error, and rotation error are reduced by 98.45%, 95.34%, and 92.67%, respectively, when compared to ORB-SLAM2. In most cases, our proposed system outperforms DS-SLAM, DynaSLAM, Detect-SLAM, RGB-D SLAM, and YOLOv5+ORB-SLAM2. The relative pose error (RPE) is only 0.0076 m, the ATE is only 0.0063 m, and the dense mapping also has better readability.
引用
下载
收藏
页码:407 / 421
页数:15
相关论文
共 50 条
  • [21] SimStu-Transformer: A Transformer-Based Approach to Simulating Student Behaviour
    Li, Zhaoxing
    Shi, Lei
    Cristea, Alexandra
    Zhou, Yunzhan
    Xiao, Chenghao
    Pan, Ziqi
    ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS AND DOCTORAL CONSORTIUM, PT II, 2022, 13356 : 348 - 351
  • [22] A Swin Transformer-Based Approach for Motorcycle Helmet Detection
    Bouhayane, Ayyoub
    Charouh, Zakaria
    Ghogho, Mounir
    Guennoun, Zouhair
    IEEE ACCESS, 2023, 11 : 74410 - 74419
  • [23] FluidsFormer: A Transformer-Based Approach for Continuous Fluid Interpolation
    Roy, Bruno
    PROCEEDINGS OF THE SIGGRAPH 2024 POSTERS, 2024,
  • [24] Transformer-based Approach for Predicting Chemical Compound Structures
    Omote, Yutaro
    Matsushita, Kyoumoto
    Iwakura, Tomoya
    Tamura, Akihiro
    Ninomiya, Takashi
    1ST CONFERENCE OF THE ASIA-PACIFIC CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 10TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (AACL-IJCNLP 2020), 2020, : 154 - 162
  • [25] Improving monocular visual SLAM in dynamic environments: an optical-flow-based approach
    Cheng, Jiyu
    Sun, Yuxiang
    Meng, Max Q-H
    ADVANCED ROBOTICS, 2019, 33 (12) : 576 - 589
  • [26] TBCUP: A Transformer-based Code Comments Updating Approach
    Liu, Shifan
    Cui, Zhanqi
    Chen, Xiang
    Yang, Jun
    Li, Li
    Zheng, Liwei
    2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 892 - 897
  • [27] EchoBERT: A Transformer-Based Approach for Behavior Detection in Echograms
    Maloy, Hakon
    IEEE ACCESS, 2020, 8 : 218372 - 218385
  • [28] A transformer-based approach to Nigerian Pidgin text generation
    Garba, Kabir
    Kolajo, Taiwo
    Agbogun, Joshua B.
    International Journal of Speech Technology, 2024, 27 (04) : 1027 - 1037
  • [29] A Transformer-Based Approach for Choosing Actions in Social Robotics
    De Benedictis, Riccardo
    Beraldo, Gloria
    Cortellessa, Gabriella
    Fracasso, Francesca
    Cesta, Amedeo
    SOCIAL ROBOTICS, ICSR 2022, PT I, 2022, 13817 : 198 - 207
  • [30] Transformer-based approach for symptom recognition and multilingual linking
    Vassileva, Sylvia
    Grazhdanski, Georgi
    Koychev, Ivan
    Boytcheva, Svetla
    DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION, 2024, 2024