A robust RGB-D SLAM based on multiple geometric features and semantic segmentation in dynamic environments

被引:12
|
作者
Kuang, Benfa [1 ]
Yuan, Jie [1 ]
Liu, Qiang [1 ]
机构
[1] Xinjiang Univ, Sch Elect Engn, Urumqi, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic scenes; point and line features; RGB-D camera; semantic segmentation; visual SLAM; EFFICIENT;
D O I
10.1088/1361-6501/ac92a0
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In indoor dynamic scenes, traditional visual simultaneous localization and mapping (SLAM) algorithms based on RGB-D cameras incorrectly use dynamic features to estimate the poses of the cameras, and do not fully utilize the geometric information in the scenes, resulting in the low positioning accuracy and robustness of SLAM systems. To solve this problem, this paper proposes an RGB-D SLAM algorithm based on multiple geometric features and semantic segmentation. The core of our SLAM system is the proposed robust exclusion method of dynamic point and line features. The method consists of the following three steps: (a) identify potential dynamic point features using motion consistency checks; (b) obtain potential motion regions via semantic segmentation, and then determine dynamic regions by combining these with dynamic point features; (c) remove point and line features in dynamic regions. The exclusion method of dynamic point and line features can be easily integrated into RGB-D SLAM systems for improving the accuracy and robustness of SLAM systems in dynamic scenes. Experimental results on the Technische Universitat Munchen (TUM) dataset demonstrate that the proposed algorithm has better positioning accuracy and stability than the original dynamic semantic (DS-SLAM) algorithm in dynamic environments. The effectiveness of the proposed algorithm is verified by comparison with other classical visual SLAM algorithms. Better mapping performance is achieved by this proposed algorithm in actual indoor scenes.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] RGB-D Based Semantic SLAM Framework for Rescue Robot
    Deng, Wenbang
    Huang, Kaihong
    Chen, Xieyuanli
    Zhou, Zhiqian
    Shi, Chenghao
    Guo, Ruibin
    Zhang, Hui
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 6023 - 6028
  • [42] Mask R-CNN Based Semantic RGB-D SLAM for Dynamic Scenes
    Zhang, Zhongqun
    Zhang, Jingtao
    Tang, Qirong
    2019 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2019, : 1151 - 1156
  • [43] PLPD-SLAM: Point-Line-Plane-based RGB-D SLAM for Dynamic Environments
    Dong, Juan
    Lu, Maobin
    Xu, Yong
    Deng, Fang
    Chen, Jie
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 719 - 724
  • [44] RGB-D SLAM method of dynamic scene based on instance segmentation and optical flow
    Wang C.
    Shi J.
    Zhu H.
    Bai S.
    Sun Y.
    Lu J.
    Huang S.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (06): : 857 - 867
  • [45] StaticFusion: Background Reconstruction for Dense RGB-D SLAM in Dynamic Environments
    Scona, Raluca
    Jaimez, Mariano
    Petillot, Yvan R.
    Fallon, Maurice
    Cremers, Daniel
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 3849 - 3856
  • [46] Linear RGB-D SLAM for Structured Environments
    Joo, Kyungdon
    Kim, Pyojin
    Hebert, Martial
    Kweon, In So
    Kim, Hyoun Jin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 8403 - 8419
  • [47] Improving RGB-D SLAM in dynamic environments: A motion removal approach
    Sun, Yuxiang
    Liu, Ming
    Meng, Max Q. -H.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 89 : 110 - 122
  • [48] RGB-D SLAM in indoor dynamic environments with two channels based on scenario classification
    Zhou, Yao
    Tao, Fazhan
    Fu, Zhumu
    Chen, Qihong
    Zhu, Longlong
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (11)
  • [49] Multi-Mask Fusion-Based RGB-D SLAM in Dynamic Environments
    Gao Y.
    Hu M.
    Chen B.
    Yang W.
    Wang J.
    Wang J.
    IEEE Sensors Journal, 2024, 24 (21) : 1 - 1
  • [50] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72