A robust RGB-D visual odometry with moving object detection in dynamic indoor scenes

被引:2
|
作者
Zhang, Xianglong [1 ]
Yu, Haiyang [1 ]
Zhuang, Yan [2 ]
机构
[1] Dalian Minzu Univ, Coll Mech & Elect Engn, Dalian, Peoples R China
[2] Dalian Univ Technol, Sch Control Sci & Engn, Dalian, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic indoor scenes; moving object detection; RGB-D SLAM; visual odometry; D SLAM; MOTION REMOVAL;
D O I
10.1049/csy2.12079
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) are the basis for many robotic applications. As the front end of SLAM, visual odometry is mainly used to estimate camera pose. In dynamic scenes, classical methods are deteriorated by dynamic objects and cannot achieve satisfactory results. In order to improve the robustness of visual odometry in dynamic scenes, this paper proposed a dynamic region detection method based on RGB-D images. Firstly, all feature points on the RGB image are classified as dynamic and static using a triangle constraint and the epipolar geometric constraint successively. Meanwhile, the depth image is clustered using the K-Means method. The classified feature points are mapped to the clustered depth image, and a dynamic or static label is assigned to each cluster according to the number of dynamic feature points. Subsequently, a dynamic region mask for the RGB image is generated based on the dynamic clusters in the depth image, and the feature points covered by the mask are all removed. The remaining static feature points are applied to estimate the camera pose. Finally, some experimental results are provided to demonstrate the feasibility and performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] A New RGB-D SLAM Method with Moving Object Detection for Dynamic Indoor Scenes
    Wang, Runzhi
    Wan, Wenhui
    Wang, Yongkang
    Di, Kaichang
    REMOTE SENSING, 2019, 11 (10)
  • [2] VISUAL ODOMETRY FOR RGB-D CAMERAS FOR DYNAMIC SCENES
    Azartash, Haleh
    Lee, Kyoung-Rok
    Nguyen, Truong Q.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [3] A robust visual odometry based on RGB-D camera in dynamic indoor environments
    Zhang, Fangfang
    Li, Qiyan
    Wang, Tingting
    Ma, Tianlei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (04)
  • [4] RGB-D DSO: Direct Sparse Odometry With RGB-D Cameras for Indoor Scenes
    Yuan, Zikang
    Cheng, Ken
    Tang, Jinhui
    Yang, Xin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4092 - 4101
  • [5] Dynamic RGB-D Visual Odometry
    Yang, Dongsheng
    Bi, Shusheng
    Cai, Yueri
    Zheng, Jingxiang
    Yuan, Chang
    2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 941 - 946
  • [6] Unsupervised object region proposals for RGB-D indoor scenes
    Deng, Zhuo
    Todorovic, Sinisa
    Latecki, Longin Jan
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 154 : 127 - 136
  • [7] Robust RGB-D Visual Odometry Based on Planar Features
    Chen, Baifan
    Liu, Chunfa
    Tong, Yu
    Wu, Qian
    2017 IEEE 7TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2017, : 449 - 453
  • [8] Robust depth-verified RGB-D visual odometry with structural regularities for indoor environments
    Xing, Jing
    Zhong, Qixue
    Liu, Jian
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (03)
  • [9] Robust RGB-D visual odometry based on edges and points
    Yao, Erliang
    Zhang, Hexin
    Xu, Hui
    Song, Haitao
    Zhang, Guoliang
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2018, 107 : 209 - 220
  • [10] Tracking by Detection: Robust Indoor RGB-D Odometry Leveraging Key Local Manhattan World
    Zhou, Zhiyu
    Gao, Zhi
    Xu, Jingzhong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06): : 4990 - 4997