DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments

被引:10
|
作者
Ruan, Chenyu [1 ]
Zang, Qiuyu [1 ]
Zhang, Kehua [2 ]
Huang, Kai [1 ]
机构
[1] Zhejiang Normal Univ, Coll Comp Sci & Technol, Jinhua 321004, Zhejiang, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Urban Rail Transit Intelligent Operat & M, Jinhua 321004, Zhejiang, Peoples R China
关键词
Dynamic objects; neural radiation fields; segment anything model (SAM); semantic segmentation; vision simultaneous localization and mapping (SLAM); ROBUST; SCENES;
D O I
10.1109/JSEN.2023.3345877
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision simultaneous localization and mapping (SLAM) is essential for adapting to new environments and for localization and is therefore widely used in robotics. However, accurate location estimation and map consistency remain challenging issues in dynamic environments. In addition, building dense scene maps is critical for spatial artificial intelligence (AI) applications such as visual localization and navigation. We propose a visual SLAM with ORB features and NeRF mapping in dynamic environments (DN-SLAM), a visual SLAM system based on oriented FAST and rotated BRIEF (ORB)-SLAM3, which uses ORB features to track dynamic objects, uses semantic segmentation to obtain potentially moving objects, and combines optical flow and the segment anything model (SAM) to perform fine segmentation and reduce the redundancy by culling dynamic objects to enhance the performance of the SLAM system in dynamic environments. Meanwhile, 3-D rendering using neural radiation field removes dynamic objects and renders them. We performed experiments on both the Technical University of Munich (TUM) red, green, blue (RGB)-D dataset and the Bonn dataset, and we compared our results with the advanced dynamic SLAM algorithms available. Our findings reveal that, when compared to ORB-SLAM3, DN-SLAM significantly improves trajectory accuracy in highly dynamic environments and achieves more accurate localization than other advanced dynamic SLAM methods and successful 3-D reconstruction of static scenes.
引用
收藏
页码:5279 / 5287
页数:9
相关论文
共 50 条
  • [41] Performance Analysis of ORB-SLAM in Foggy Environments
    Singeis, Rita
    Dogru, Sedat
    Marques, Lino
    ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE ADVANCES IN ROBOTICS, VOL 1, 2024, 976 : 209 - 221
  • [42] Research on the application of NeRF based on dense point clouds in visual SLAM mapping tasks
    Chen, Jiupeng
    Chen, Zhifan
    San, Hongjun
    Xu, Bei
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2024, 45 (07): : 110 - 120
  • [43] HE-SLAM: a Stereo SLAM System Based on Histogram Equalization and ORB Features
    Fang, Yinghong
    Shan, Guangcun
    Wang, Tian
    Li, Xin
    Liu, Wenliang
    Snoussi, Hichem
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 4272 - 4276
  • [44] Stereo Visual SLAM Based On Plane Features In Road Environments
    Fan, Yu
    Wang, Zhi
    Zhang, Peng
    2024 10TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, CONTROL AND ROBOTICS, EECR 2024, 2024, : 291 - 297
  • [45] Planar Features for Visual SLAM
    Pietzsch, Tobias
    KI 2008: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2008, 5243 : 119 - 126
  • [46] Object Mobility classification based Visual SLAM in Dynamic Environments
    Zhang, Huayan
    Zhang, Tianwei
    Li, Yang
    Zhang, Lei
    Wang, Wanpeng
    2020 17TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2020, : 437 - 441
  • [47] OC-SLAM: Steadily Tracking and Mapping in Dynamic Environments
    Wu, Zhenyu
    Deng, Xiangyu
    Li, Shengming
    Li, Yingshun
    FRONTIERS IN ENERGY RESEARCH, 2021, 9
  • [48] On Combining Visual SLAM and Dense Scene Flow to Increase the Robustness of Localization and Mapping in Dynamic Environments
    Alcantarilla, Pablo F.
    Yebes, Jose J.
    Almazan, Javier
    Bergasa, Luis M.
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2012, : 1290 - 1297
  • [49] Visual SLAM and Structure from Motion in Dynamic Environments: A Survey
    Saputra, Muhamad Risqi U.
    Markham, Andrew
    Trigoni, Niki
    ACM COMPUTING SURVEYS, 2018, 51 (02)
  • [50] MISD-SLAM: Multimodal Semantic SLAM for Dynamic Environments
    You, Yingxuan
    Wei, Peng
    Cai, Jialun
    Huang, Weibo
    Kang, Risheng
    Liu, Hong
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022