DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments

被引:0
|
作者
Ruan, Chenyu [1 ]
Zang, Qiuyu [1 ]
Zhang, Kehua [2 ]
Huang, Kai [1 ]
机构
[1] Zhejiang Normal Univ, Coll Comp Sci & Technol, Jinhua 321004, Zhejiang, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Urban Rail Transit Intelligent Operat & M, Jinhua 321004, Zhejiang, Peoples R China
关键词
Dynamic objects; neural radiation fields; segment anything model (SAM); semantic segmentation; vision simultaneous localization and mapping (SLAM); ROBUST; SCENES;
D O I
10.1109/JSEN.2023.3345877
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision simultaneous localization and mapping (SLAM) is essential for adapting to new environments and for localization and is therefore widely used in robotics. However, accurate location estimation and map consistency remain challenging issues in dynamic environments. In addition, building dense scene maps is critical for spatial artificial intelligence (AI) applications such as visual localization and navigation. We propose a visual SLAM with ORB features and NeRF mapping in dynamic environments (DN-SLAM), a visual SLAM system based on oriented FAST and rotated BRIEF (ORB)-SLAM3, which uses ORB features to track dynamic objects, uses semantic segmentation to obtain potentially moving objects, and combines optical flow and the segment anything model (SAM) to perform fine segmentation and reduce the redundancy by culling dynamic objects to enhance the performance of the SLAM system in dynamic environments. Meanwhile, 3-D rendering using neural radiation field removes dynamic objects and renders them. We performed experiments on both the Technical University of Munich (TUM) red, green, blue (RGB)-D dataset and the Bonn dataset, and we compared our results with the advanced dynamic SLAM algorithms available. Our findings reveal that, when compared to ORB-SLAM3, DN-SLAM significantly improves trajectory accuracy in highly dynamic environments and achieves more accurate localization than other advanced dynamic SLAM methods and successful 3-D reconstruction of static scenes.
引用
下载
收藏
页码:5279 / 5287
页数:9
相关论文
共 50 条
  • [31] Visual SLAM in dynamic environments based on object detection
    Yongbao Ai
    Ting Rui
    Xiaoqiang Yang
    Jialin He
    Lei Fu
    Jianbin Li
    Ming Lu
    Defence Technology, 2021, 17 (05) : 1712 - 1721
  • [32] DynaVINS: A Visual-Inertial SLAM for Dynamic Environments
    Song, Seungwon
    Lim, Hyungtae
    Lee, Alex Junho
    Myung, Hyun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04): : 11523 - 11530
  • [33] Blitz-SLAM: A semantic SLAM in dynamic environments
    Fan, Yingchun
    Zhang, Qichi
    Tang, Yuliang
    Liu, Shaofen
    Han, Hong
    PATTERN RECOGNITION, 2022, 121
  • [34] DM-SLAM: Monocular SLAM in Dynamic Environments
    Lu, Xiaoyun
    Wang, Hu
    Tang, Shuming
    Huang, Huimin
    Li, Chuang
    APPLIED SCIENCES-BASEL, 2020, 10 (12):
  • [35] RSO-SLAM: A Robust Semantic Visual SLAM With Optical Flow in Complex Dynamic Environments
    Qin, Liang
    Wu, Chang
    Chen, Zhenyu
    Kong, Xiaotong
    Lv, Zejie
    Zhao, Zhiqi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 1 - 16
  • [36] Comparison of Visual SLAM Algorithms ORB-SLAM2, RTAB-Map and SPTAM in Internal and External Environments with ROS
    de Jesus, Kesse Jonatas
    Kobs, Henry Julio
    Cukla, Anselmo Rafael
    de Souza Leite Cuadros, Marco Antonio
    Tello Gamarra, Daniel Fernando
    2021 LATIN AMERICAN ROBOTICS SYMPOSIUM / 2021 BRAZILIAN SYMPOSIUM ON ROBOTICS / 2021 WORKSHOP OF ROBOTICS IN EDUCATION (LARS-SBR-WRE 2021), 2021, : 216 - 221
  • [37] YKP-SLAM: A Visual SLAM Based on Static Probability Update Strategy for Dynamic Environments
    Liu, Lisang
    Guo, Jiangfeng
    Zhang, Rongsheng
    ELECTRONICS, 2022, 11 (18)
  • [38] Research on the application of NeRF based on dense point clouds in visual SLAM mapping tasks
    Chen, Jiupeng
    Chen, Zhifan
    San, Hongjun
    Xu, Bei
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2024, 45 (07): : 110 - 120
  • [39] USD-SLAM: A Universal Visual SLAM Based on Large Segmentation Model in Dynamic Environments
    Wang, Jingwei
    Ren, Yizhang
    Li, Zhiwei
    Xie, Xiaoming
    Chen, Zilong
    Shen, Tianyu
    Liu, Huaping
    Wang, Kunfeng
    IEEE Robotics and Automation Letters, 2024, 9 (12) : 11810 - 11817
  • [40] Performance Analysis of ORB-SLAM in Foggy Environments
    Singeis, Rita
    Dogru, Sedat
    Marques, Lino
    ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE ADVANCES IN ROBOTICS, VOL 1, 2024, 976 : 209 - 221