DM-SLAM: A Feature-Based SLAM System for Rigid Dynamic Scenes

被引:40
|
作者
Cheng, Junhao [1 ,2 ]
Wang, Zhi [3 ]
Zhou, Hongyan [4 ]
Li, Li [1 ]
Yao, Jian [1 ,2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430070, Hubei, Peoples R China
[2] Shenzhen Jimuyida Technol Co Ltd, Shenzhen 518000, Guangdong, Peoples R China
[3] Xi An Jiao Tong Univ, Sch Software Engn, Xian 710049, Shaanxi, Peoples R China
[4] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430070, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
visual SLAM; deep learning; dynamic scenes; Mask R-CNN; optical flow; ORB-SLAM2; MONOCULAR SLAM; ODOMETRY;
D O I
10.3390/ijgi9040202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most Simultaneous Localization and Mapping (SLAM) methods assume that environments are static. Such a strong assumption limits the application of most visual SLAM systems. The dynamic objects will cause many wrong data associations during the SLAM process. To address this problem, a novel visual SLAM method that follows the pipeline of feature-based methods called DM-SLAM is proposed in this paper. DM-SLAM combines an instance segmentation network with optical flow information to improve the location accuracy in dynamic environments, which supports monocular, stereo, and RGB-D sensors. It consists of four modules: semantic segmentation, ego-motion estimation, dynamic point detection and a feature-based SLAM framework. The semantic segmentation module obtains pixel-wise segmentation results of potentially dynamic objects, and the ego-motion estimation module calculates the initial pose. In the third module, two different strategies are presented to detect dynamic feature points for RGB-D/stereo and monocular cases. In the first case, the feature points with depth information are reprojected to the current frame. The reprojection offset vectors are used to distinguish the dynamic points. In the other case, we utilize the epipolar constraint to accomplish this task. Furthermore, the static feature points left are fed into the fourth module. The experimental results on the public TUM and KITTI datasets demonstrate that DM-SLAM outperforms the standard visual SLAM baselines in terms of accuracy in highly dynamic environments.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Immediate Pose Recovery Method for Untracked Frames in Feature-Based SLAM
    Dou, Hexuan
    Wang, Zhenhuan
    Wang, Changhong
    Zhao, Xinyang
    SENSORS, 2024, 24 (03)
  • [42] FEATURE-BASED 3D OUTDOOR SLAM WITH LOCAL FILTERS
    Ulas, Cihan
    Temeltas, Hakan
    INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2013, 28 (03): : 226 - 233
  • [43] Feature-based SLAM for Imaging Sonar with Under-constrained Landmarks
    Westman, Eric
    Hinduja, Akshay
    Kaess, Michael
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 3629 - 3636
  • [44] Sensitivity Study for Feature-Based Monocular 3D SLAM
    Bergstrom, Niklas
    Raabe, Chris
    Saito, Kenjiro
    Saad, Emad
    Vian, John
    2015 IEEE AEROSPACE CONFERENCE, 2015,
  • [45] Dense Mapping from Feature-Based Monocular SLAM Based on Depth Prediction
    Duan, Yongli
    Zhang, Jing
    Yang, Lingyu
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [46] A Survey of Visual SLAM for Scenes with Dynamic Objects
    Gao, Xingbo
    Shi, Xuhua
    Ge, Qunfeng
    Chen, Kuiye
    Jiqiren/Robot, 2021, 43 (06): : 733 - 750
  • [47] A Dense Visual SLAM Method in Dynamic Scenes
    Liu, Xia
    Zhang, Jiachen
    Wang, Bo
    Jiang, Qifeng
    IEEE ACCESS, 2023, 11 : 138530 - 138539
  • [48] ULG-SLAM: A Novel Unsupervised Learning and Geometric Feature-Based Visual SLAM Algorithm for Robot Localizability Estimation
    Huang, Yihan
    Xie, Fei
    Zhao, Jing
    Gao, Zhilin
    Chen, Jun
    Zhao, Fei
    Liu, Xixiang
    REMOTE SENSING, 2024, 16 (11)
  • [49] UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes
    Liu, Jun
    Dong, Junyuan
    Hu, Mingming
    Lu, Xu
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02): : 206 - 218
  • [50] Visual SLAM Mapping Based on YOLOv5 in Dynamic Scenes
    Zhang, Xinguang
    Zhang, Ruidong
    Wang, Xiankun
    APPLIED SCIENCES-BASEL, 2022, 12 (22):