A robust RGB-D SLAM based on multiple geometric features and semantic segmentation in dynamic environments

被引:12
|
作者
Kuang, Benfa [1 ]
Yuan, Jie [1 ]
Liu, Qiang [1 ]
机构
[1] Xinjiang Univ, Sch Elect Engn, Urumqi, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic scenes; point and line features; RGB-D camera; semantic segmentation; visual SLAM; EFFICIENT;
D O I
10.1088/1361-6501/ac92a0
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In indoor dynamic scenes, traditional visual simultaneous localization and mapping (SLAM) algorithms based on RGB-D cameras incorrectly use dynamic features to estimate the poses of the cameras, and do not fully utilize the geometric information in the scenes, resulting in the low positioning accuracy and robustness of SLAM systems. To solve this problem, this paper proposes an RGB-D SLAM algorithm based on multiple geometric features and semantic segmentation. The core of our SLAM system is the proposed robust exclusion method of dynamic point and line features. The method consists of the following three steps: (a) identify potential dynamic point features using motion consistency checks; (b) obtain potential motion regions via semantic segmentation, and then determine dynamic regions by combining these with dynamic point features; (c) remove point and line features in dynamic regions. The exclusion method of dynamic point and line features can be easily integrated into RGB-D SLAM systems for improving the accuracy and robustness of SLAM systems in dynamic scenes. Experimental results on the Technische Universitat Munchen (TUM) dataset demonstrate that the proposed algorithm has better positioning accuracy and stability than the original dynamic semantic (DS-SLAM) algorithm in dynamic environments. The effectiveness of the proposed algorithm is verified by comparison with other classical visual SLAM algorithms. Better mapping performance is achieved by this proposed algorithm in actual indoor scenes.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Semantic Segmentation based Dense RGB-D SLAM in Dynamic Environments
    Zhang, Jianbo
    Liu, Yanjie
    Chen, Junguo
    Ma, Liulong
    Jin, Dong
    Chen, Jiao
    2019 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, AUTOMATION AND CONTROL TECHNOLOGIES (AIACT 2019), 2019, 1267
  • [2] RS-SLAM: A Robust Semantic SLAM in Dynamic Environments Based on RGB-D Sensor
    Ran, Teng
    Yuan, Liang
    Zhang, Jianbo
    Tang, Dingxin
    He, Li
    IEEE SENSORS JOURNAL, 2021, 21 (18) : 20657 - 20664
  • [3] Improving RGB-D SLAM accuracy in dynamic environments based on semantic and geometric constraints
    Wang, Xiqi
    Zheng, Shunyi
    Lin, Xiaohu
    Zhu, Fengbo
    MEASUREMENT, 2023, 217
  • [4] Improving RGB-D SLAM in dynamic environments using semantic aided segmentation
    Kenye, Lhilo
    Kala, Rahul
    ROBOTICA, 2022, 40 (06) : 2065 - 2090
  • [5] Joining geometric and RGB features for RGB-D semantic segmentation
    Zhang, Shaopeng
    Zhong, Min
    Zeng, Gang
    Gan, Rui
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [6] Robust RGB-D SLAM in Dynamic Environments using Geometry and Semantic Information
    Xiao, Yao
    Zou, Junjie
    Jin, Ronghe
    Mei, Tiancan
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 731 - 736
  • [7] Robust and Efficient RGB-D SLAM in Dynamic Environments
    Yang, Xin
    Yuan, Zikang
    Zhu, Dongfu
    Chi, Cheng
    Li, Kun
    Liao, Chunyuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 4208 - 4219
  • [8] RGB-D SLAM in Dynamic Environments with Multilevel Semantic Mapping
    Qin, Yusheng
    Mei, Tiancan
    Gao, Zhi
    Lin, Zhipeng
    Song, Weiwei
    Zhao, Xuhui
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 105 (04)
  • [9] RGB-D SLAM in Dynamic Environments with Multilevel Semantic Mapping
    Yusheng Qin
    Tiancan Mei
    Zhi Gao
    Zhipeng Lin
    Weiwei Song
    Xuhui Zhao
    Journal of Intelligent & Robotic Systems, 2022, 105
  • [10] DRG-SLAM: A Semantic RGB-D SLAM using Geometric Features for Indoor Dynamic Scene
    Wang, Yanan
    Xu, Kun
    Tian, Yaobin
    Ding, Xilun
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1352 - 1359