A robust RGB-D visual odometry with moving object detection in dynamic indoor scenes

被引:2
|
作者
Zhang, Xianglong [1 ]
Yu, Haiyang [1 ]
Zhuang, Yan [2 ]
机构
[1] Dalian Minzu Univ, Coll Mech & Elect Engn, Dalian, Peoples R China
[2] Dalian Univ Technol, Sch Control Sci & Engn, Dalian, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic indoor scenes; moving object detection; RGB-D SLAM; visual odometry; D SLAM; MOTION REMOVAL;
D O I
10.1049/csy2.12079
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) are the basis for many robotic applications. As the front end of SLAM, visual odometry is mainly used to estimate camera pose. In dynamic scenes, classical methods are deteriorated by dynamic objects and cannot achieve satisfactory results. In order to improve the robustness of visual odometry in dynamic scenes, this paper proposed a dynamic region detection method based on RGB-D images. Firstly, all feature points on the RGB image are classified as dynamic and static using a triangle constraint and the epipolar geometric constraint successively. Meanwhile, the depth image is clustered using the K-Means method. The classified feature points are mapped to the clustered depth image, and a dynamic or static label is assigned to each cluster according to the number of dynamic feature points. Subsequently, a dynamic region mask for the RGB image is generated based on the dynamic clusters in the depth image, and the feature points covered by the mask are all removed. The remaining static feature points are applied to estimate the camera pose. Finally, some experimental results are provided to demonstrate the feasibility and performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Robust Real-Time Visual Odometry for Dense RGB-D Mapping
    Whelan, Thomas
    Johannsson, Hordur
    Kaess, Michael
    Leonard, John J.
    McDonald, John
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 5724 - 5731
  • [22] RGB-D SLAM with moving object tracking in dynamic environments
    Dai, Weichen
    Zhang, Yu
    Zheng, Yuxin
    Sun, Donglei
    Li, Ping
    IET CYBER-SYSTEMS AND ROBOTICS, 2021, 3 (04) : 281 - 291
  • [23] Semantic parsing for priming object detection in indoors RGB-D scenes
    Cadena, Cesar
    Kosecka, Jana
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2015, 34 (4-5): : 582 - 597
  • [24] Robust Object Detection by Cuboid Matching with Local Plane Optimization in Indoor RGB-D Images
    Guo, Lin
    Fan, Guoliang
    Sheng, Weihua
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [25] Robustness to Lighting Variations: An RGB-D Indoor Visual Odometry Using Line Segments
    Lu, Yan
    Song, Dezhen
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 688 - 694
  • [26] DRSO-SLAM: A Dynamic RGB-D SLAM Algorithm for Indoor Dynamic Scenes
    Yu, Naigong
    Gan, Mengzhe
    Yu, Hejie
    Yang, Kang
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1052 - 1058
  • [27] Saliency-Induced Moving Object Detection for Robust RGB-D Vision Navigation Under Complex Dynamic Environments
    Sun, Chao
    Wu, Xing
    Sun, Jia
    Sun, Changyin
    Xu, Mingzhu
    Ge, Quanbo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (10) : 10716 - 10734
  • [28] Feature Regions Segmentation based RGB-D Visual Odometry in Dynamic Environment
    Zhang, Yu
    Dai, Weichen
    Peng, Zhen
    Li, Ping
    Fang, Zheng
    IECON 2018 - 44TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2018, : 5648 - 5655
  • [29] RGB-D Visual Odometry Combined with Points and Lines
    Lu Junxin
    Fang Zhijun
    Chen Jieyu
    Gao Yongbin
    ACTA OPTICA SINICA, 2021, 41 (04)
  • [30] Adaptive Visual Odometry Using RGB-D Cameras
    Fabian, Joshua R.
    Clayton, Garrett M.
    2014 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2014, : 1533 - 1538