A robust RGB-D visual odometry with moving object detection in dynamic indoor scenes

被引:2
|
作者
Zhang, Xianglong [1 ]
Yu, Haiyang [1 ]
Zhuang, Yan [2 ]
机构
[1] Dalian Minzu Univ, Coll Mech & Elect Engn, Dalian, Peoples R China
[2] Dalian Univ Technol, Sch Control Sci & Engn, Dalian, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic indoor scenes; moving object detection; RGB-D SLAM; visual odometry; D SLAM; MOTION REMOVAL;
D O I
10.1049/csy2.12079
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) are the basis for many robotic applications. As the front end of SLAM, visual odometry is mainly used to estimate camera pose. In dynamic scenes, classical methods are deteriorated by dynamic objects and cannot achieve satisfactory results. In order to improve the robustness of visual odometry in dynamic scenes, this paper proposed a dynamic region detection method based on RGB-D images. Firstly, all feature points on the RGB image are classified as dynamic and static using a triangle constraint and the epipolar geometric constraint successively. Meanwhile, the depth image is clustered using the K-Means method. The classified feature points are mapped to the clustered depth image, and a dynamic or static label is assigned to each cluster according to the number of dynamic feature points. Subsequently, a dynamic region mask for the RGB image is generated based on the dynamic clusters in the depth image, and the feature points covered by the mask are all removed. The remaining static feature points are applied to estimate the camera pose. Finally, some experimental results are provided to demonstrate the feasibility and performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Maximum Clique based RGB-D Visual Odometry
    Zhang, Yigong
    Hou, Zhixing
    Yang, Jian
    Kong, Hui
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2764 - 2769
  • [32] Direct RGB-D visual odometry with point features
    Yao, Zhigang
    An, Xu
    Charrier, Christophe
    Rosenberger, Christophe
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (05) : 1077 - 1089
  • [33] Experimental Evaluation of RGB-D Visual Odometry Methods
    Fang, Zheng
    Zhang, Yu
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2015, 12
  • [34] An Adaptive Visual Odometry Based on RGB-D Sensors
    Zheng, Enhui
    Wang, Tantan
    Liu, Zheng
    Xu, Ling
    2019 4TH INTERNATIONAL CONFERENCE ON ELECTROMECHANICAL CONTROL TECHNOLOGY AND TRANSPORTATION (ICECTT 2019), 2019, : 154 - 158
  • [35] Robust Real-time RGB-D Visual Odometry in Dynamic Environments via Rigid Motion Model
    Lee, Sangil
    Son, Clark Youngdong
    Kim, H. Jin
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 6891 - 6898
  • [36] Saliency-Guided Detection of Unknown Objects in RGB-D Indoor Scenes
    Bao, Jiatong
    Jia, Yunyi
    Cheng, Yu
    Xi, Ning
    SENSORS, 2015, 15 (09) : 21054 - 21074
  • [37] Towards Dense Moving Object Segmentation based Robust Dense RGB-D SLAM in Dynamic Scenarios
    Wang, Youbing
    Huang, Shoudong
    2014 13TH INTERNATIONAL CONFERENCE ON CONTROL AUTOMATION ROBOTICS & VISION (ICARCV), 2014, : 1841 - 1846
  • [38] Efficient and Robust Indoor People Detection based on RGB-D Camera
    He, Qi
    Liu, Kuixiang
    Qu, Lei
    2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 1063 - 1068
  • [39] Dynamic Selective Network for RGB-D Salient Object Detection
    Wen, Hongfa
    Yan, Chenggang
    Zhou, Xiaofei
    Cong, Runmin
    Sun, Yaoqi
    Zheng, Bolun
    Zhang, Jiyong
    Bao, Yongjun
    Ding, Guiguang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 9179 - 9192
  • [40] DYNAMIC SELECTION NETWORK FOR RGB-D SALIENT OBJECT DETECTION
    Zhou, Jinlin
    Luo, Zhiming
    Li, Shaozi
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 776 - 780