DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments

被引:10
|
作者
Ruan, Chenyu [1 ]
Zang, Qiuyu [1 ]
Zhang, Kehua [2 ]
Huang, Kai [1 ]
机构
[1] Zhejiang Normal Univ, Coll Comp Sci & Technol, Jinhua 321004, Zhejiang, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Urban Rail Transit Intelligent Operat & M, Jinhua 321004, Zhejiang, Peoples R China
关键词
Dynamic objects; neural radiation fields; segment anything model (SAM); semantic segmentation; vision simultaneous localization and mapping (SLAM); ROBUST; SCENES;
D O I
10.1109/JSEN.2023.3345877
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision simultaneous localization and mapping (SLAM) is essential for adapting to new environments and for localization and is therefore widely used in robotics. However, accurate location estimation and map consistency remain challenging issues in dynamic environments. In addition, building dense scene maps is critical for spatial artificial intelligence (AI) applications such as visual localization and navigation. We propose a visual SLAM with ORB features and NeRF mapping in dynamic environments (DN-SLAM), a visual SLAM system based on oriented FAST and rotated BRIEF (ORB)-SLAM3, which uses ORB features to track dynamic objects, uses semantic segmentation to obtain potentially moving objects, and combines optical flow and the segment anything model (SAM) to perform fine segmentation and reduce the redundancy by culling dynamic objects to enhance the performance of the SLAM system in dynamic environments. Meanwhile, 3-D rendering using neural radiation field removes dynamic objects and renders them. We performed experiments on both the Technical University of Munich (TUM) red, green, blue (RGB)-D dataset and the Bonn dataset, and we compared our results with the advanced dynamic SLAM algorithms available. Our findings reveal that, when compared to ORB-SLAM3, DN-SLAM significantly improves trajectory accuracy in highly dynamic environments and achieves more accurate localization than other advanced dynamic SLAM methods and successful 3-D reconstruction of static scenes.
引用
收藏
页码:5279 / 5287
页数:9
相关论文
共 50 条
  • [21] An Adaptive ORB-SLAM3 System for Outdoor Dynamic Environments
    Zang, Qiuyu
    Zhang, Kehua
    Wang, Ling
    Wu, Lintong
    SENSORS, 2023, 23 (03)
  • [22] Dynamic SLAM: A Visual SLAM in Outdoor Dynamic Scenes
    Wen, Shuhuan
    Li, Xiongfei
    Liu, Xin
    Li, Jiaqi
    Tao, Sheng
    Long, Yidan
    Qiu, Tony
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [23] Visual-Inertial-Laser SLAM Based on ORB-SLAM3
    Cao, Meng
    Zhang, Jia
    Chen, Wenjie
    UNMANNED SYSTEMS, 2024, 12 (05) : 903 - 912
  • [24] MN- SLAM: Multi-networks Visual SLAM for Dynamic and Complicated Environments
    Ma, Aili
    Li, Peijun
    Zhang, Chun
    Wang, Zhihua
    Wang, Ziqiang
    2022 11TH INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND APPLICATIONS, ICICA, 2022, : 73 - 77
  • [25] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Liu, Qiang
    Yuan, Jie
    Kuang, Benfa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 53531 - 53547
  • [26] OTE-SLAM: An Object Tracking Enhanced Visual SLAM System for Dynamic Environments
    Chang, Yimeng
    Hu, Jun
    Xu, Shiyou
    SENSORS, 2023, 23 (18)
  • [27] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Qiang Liu
    Jie Yuan
    Benfa Kuang
    Multimedia Tools and Applications, 2024, 83 : 53531 - 53547
  • [28] Visual SLAM in dynamic environments based on object detection
    Ai, Yong-bao
    Rui, Ting
    Yang, Xiao-qiang
    He, Jia-lin
    Fu, Lei
    Li, Jian-bin
    Lu, Ming
    DEFENCE TECHNOLOGY, 2021, 17 (05) : 1712 - 1721
  • [29] Robust Visual SLAM Algorithm for Dynamic Indoor Environments
    Fang, Lijin
    Wang, Keqi
    Wan, Yingcai
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 4169 - 4174
  • [30] Visual SLAM in dynamic environments based on object detection
    Yongbao Ai
    Ting Rui
    Xiaoqiang Yang
    Jialin He
    Lei Fu
    Jianbin Li
    Ming Lu
    Defence Technology, 2021, 17 (05) : 1712 - 1721