DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments

被引:0
|
作者
Ruan, Chenyu [1 ]
Zang, Qiuyu [1 ]
Zhang, Kehua [2 ]
Huang, Kai [1 ]
机构
[1] Zhejiang Normal Univ, Coll Comp Sci & Technol, Jinhua 321004, Zhejiang, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Urban Rail Transit Intelligent Operat & M, Jinhua 321004, Zhejiang, Peoples R China
关键词
Dynamic objects; neural radiation fields; segment anything model (SAM); semantic segmentation; vision simultaneous localization and mapping (SLAM); ROBUST; SCENES;
D O I
10.1109/JSEN.2023.3345877
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision simultaneous localization and mapping (SLAM) is essential for adapting to new environments and for localization and is therefore widely used in robotics. However, accurate location estimation and map consistency remain challenging issues in dynamic environments. In addition, building dense scene maps is critical for spatial artificial intelligence (AI) applications such as visual localization and navigation. We propose a visual SLAM with ORB features and NeRF mapping in dynamic environments (DN-SLAM), a visual SLAM system based on oriented FAST and rotated BRIEF (ORB)-SLAM3, which uses ORB features to track dynamic objects, uses semantic segmentation to obtain potentially moving objects, and combines optical flow and the segment anything model (SAM) to perform fine segmentation and reduce the redundancy by culling dynamic objects to enhance the performance of the SLAM system in dynamic environments. Meanwhile, 3-D rendering using neural radiation field removes dynamic objects and renders them. We performed experiments on both the Technical University of Munich (TUM) red, green, blue (RGB)-D dataset and the Bonn dataset, and we compared our results with the advanced dynamic SLAM algorithms available. Our findings reveal that, when compared to ORB-SLAM3, DN-SLAM significantly improves trajectory accuracy in highly dynamic environments and achieves more accurate localization than other advanced dynamic SLAM methods and successful 3-D reconstruction of static scenes.
引用
下载
收藏
页码:5279 / 5287
页数:9
相关论文
共 50 条
  • [41] HE-SLAM: a Stereo SLAM System Based on Histogram Equalization and ORB Features
    Fang, Yinghong
    Shan, Guangcun
    Wang, Tian
    Li, Xin
    Liu, Wenliang
    Snoussi, Hichem
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 4272 - 4276
  • [42] Planar Features for Visual SLAM
    Pietzsch, Tobias
    KI 2008: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2008, 5243 : 119 - 126
  • [43] Object Mobility classification based Visual SLAM in Dynamic Environments
    Zhang, Huayan
    Zhang, Tianwei
    Li, Yang
    Zhang, Lei
    Wang, Wanpeng
    2020 17TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2020, : 437 - 441
  • [44] OC-SLAM: Steadily Tracking and Mapping in Dynamic Environments
    Wu, Zhenyu
    Deng, Xiangyu
    Li, Shengming
    Li, Yingshun
    FRONTIERS IN ENERGY RESEARCH, 2021, 9
  • [45] On Combining Visual SLAM and Dense Scene Flow to Increase the Robustness of Localization and Mapping in Dynamic Environments
    Alcantarilla, Pablo F.
    Yebes, Jose J.
    Almazan, Javier
    Bergasa, Luis M.
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2012, : 1290 - 1297
  • [46] Visual SLAM and Structure from Motion in Dynamic Environments: A Survey
    Saputra, Muhamad Risqi U.
    Markham, Andrew
    Trigoni, Niki
    ACM COMPUTING SURVEYS, 2018, 51 (02)
  • [47] Dynam-SLAM: An Accurate, Robust Stereo Visual-Inertial SLAM Method in Dynamic Environments
    Yin, Hesheng
    Li, Shaomiao
    Tao, Yu
    Guo, Junlong
    Huang, Bo
    IEEE TRANSACTIONS ON ROBOTICS, 2022,
  • [48] MISD-SLAM: Multimodal Semantic SLAM for Dynamic Environments
    You, Yingxuan
    Wei, Peng
    Cai, Jialun
    Huang, Weibo
    Kang, Risheng
    Liu, Hong
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [49] Robust Stereo Visual SLAM for Dynamic Environments With Moving Object
    Li, Gang
    Liao, Xiang
    Huang, Huilan
    Song, Shaojian
    Liu, Bin
    Zeng, Yawen
    IEEE ACCESS, 2021, 9 : 32310 - 32320
  • [50] A Novel Visual SLAM System for Autonomous Vehicles in Dynamic Environments
    Zeng, Xinyu
    He, Ying
    Yu, F. Richard
    Zhou, Guang
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,