DN-SLAM: A Visual SLAM With ORB Features and NeRF Mapping in Dynamic Environments

被引:0
|
作者
Ruan, Chenyu [1 ]
Zang, Qiuyu [1 ]
Zhang, Kehua [2 ]
Huang, Kai [1 ]
机构
[1] Zhejiang Normal Univ, Coll Comp Sci & Technol, Jinhua 321004, Zhejiang, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Urban Rail Transit Intelligent Operat & M, Jinhua 321004, Zhejiang, Peoples R China
关键词
Dynamic objects; neural radiation fields; segment anything model (SAM); semantic segmentation; vision simultaneous localization and mapping (SLAM); ROBUST; SCENES;
D O I
10.1109/JSEN.2023.3345877
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision simultaneous localization and mapping (SLAM) is essential for adapting to new environments and for localization and is therefore widely used in robotics. However, accurate location estimation and map consistency remain challenging issues in dynamic environments. In addition, building dense scene maps is critical for spatial artificial intelligence (AI) applications such as visual localization and navigation. We propose a visual SLAM with ORB features and NeRF mapping in dynamic environments (DN-SLAM), a visual SLAM system based on oriented FAST and rotated BRIEF (ORB)-SLAM3, which uses ORB features to track dynamic objects, uses semantic segmentation to obtain potentially moving objects, and combines optical flow and the segment anything model (SAM) to perform fine segmentation and reduce the redundancy by culling dynamic objects to enhance the performance of the SLAM system in dynamic environments. Meanwhile, 3-D rendering using neural radiation field removes dynamic objects and renders them. We performed experiments on both the Technical University of Munich (TUM) red, green, blue (RGB)-D dataset and the Bonn dataset, and we compared our results with the advanced dynamic SLAM algorithms available. Our findings reveal that, when compared to ORB-SLAM3, DN-SLAM significantly improves trajectory accuracy in highly dynamic environments and achieves more accurate localization than other advanced dynamic SLAM methods and successful 3-D reconstruction of static scenes.
引用
下载
收藏
页码:5279 / 5287
页数:9
相关论文
共 50 条
  • [1] Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mapping
    Chung, Chi-Ming
    Tseng, Yang-Che
    Hsu, Ya-Ching
    Shi, Xiang-Qian
    Hua, Yun-Hung
    Yeh, Jia-Fong
    Chen, Wen-Chin
    Chen, Yi-Ting
    Hsu, Winston H.
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9400 - 9406
  • [2] VI-NeRF-SLAM: a real-time visual–inertial SLAM with NeRF mapping
    DaoQing Liao
    Wei Ai
    Journal of Real-Time Image Processing, 2024, 21
  • [3] Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2
    Li, Yawen
    Song, Guangming
    Hao, Shuang
    Mao, Juzheng
    Song, Aiguo
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2023, 50 (03): : 542 - 554
  • [4] A monocular ORB-SLAM in dynamic environments
    Cui, Linyan
    Wen, Fei
    2018 INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SCIENCE AND APPLICATION TECHNOLOGY, 2019, 1168
  • [5] VI-NeRF-SLAM: a real-time visual-inertial SLAM with NeRF mapping
    Liao, Daoqing
    Ai, Wei
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (02)
  • [6] Visual SLAM Algorithm Based on ORB Features and Line Features
    Yu, Zhuoyun
    Min, Huasong
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3003 - 3008
  • [7] OVD-SLAM: An Online Visual SLAM for Dynamic Environments
    He, Jiaming
    Li, Mingrui
    Wang, Yangyang
    Wang, Hongyu
    IEEE SENSORS JOURNAL, 2023, 23 (12) : 13210 - 13219
  • [8] SOF-SLAM: A Semantic Visual SLAM for Dynamic Environments
    Cui, Linyan
    Ma, Chaowei
    IEEE ACCESS, 2019, 7 : 166528 - 166539
  • [9] An Embedded Visual SLAM Algorithm based on Kinect and ORB Features
    Xu Fen
    Wang Zhen
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 6026 - 6031
  • [10] DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
    Yu, Chao
    Liu, Zuxin
    Liu, Xin-Jun
    Xie, Fugui
    Yang, Yi
    Wei, Qi
    Fei, Qiao
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 1168 - 1174