Robust RGB-D visual odometry based on edges and points

被引:17
|
作者
Yao, Erliang [1 ]
Zhang, Hexin [1 ]
Xu, Hui [1 ]
Song, Haitao [1 ]
Zhang, Guoliang [2 ]
机构
[1] High Tech Inst Xian, Dept Control Engn, Xian, Shaanxi, Peoples R China
[2] Chengdu Univ Informat Technol, Coll Controlling Engn, Chengdu, Sichuan, Peoples R China
关键词
Localization; Visual odometry; Dynamic environments; Edge alignment; Bundle adjustment; SLAM;
D O I
10.1016/j.robot.2018.06.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Localization in unknown environments is a fundamental requirement for robots. Egomotion estimation based on visual information is a hot research topic. However, most visual odometry (VO) or visual Simultaneous Localization and Mapping (vSLAM) approaches assume static environments. To achieve robust and precise localization in dynamic environments, we propose a novel VO based on edges and points for RGB-D cameras. In contrast to dense motion segmentation, sparse edge alignment with distance transform (DT) errors is adopted to detect the states of image areas. Features in dynamic areas are ignored in egomotion estimation with reprojection errors. Meanwhile, static weights calculated by DT errors are added to pose estimation. Furthermore, local bundle adjustment is utilized to improve the consistencies of the local map and the camera localization. The proposed approach can be implemented in real time. Experiments are implemented on the challenging sequences of the TUM RGB-D dataset. The results demonstrate that the proposed robust VO achieves more accurate and more stable localization than the state-of-the-art robust VO or SLAM approaches in dynamic environments. (C) 2018 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:209 / 220
页数:12
相关论文
共 50 条
  • [1] Robust RGB-D Visual Odometry Based on Planar Features
    Chen, Baifan
    Liu, Chunfa
    Tong, Yu
    Wu, Qian
    2017 IEEE 7TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2017, : 449 - 453
  • [2] RGB-D Visual Odometry Combined with Points and Lines
    Lu Junxin
    Fang Zhijun
    Chen Jieyu
    Gao Yongbin
    ACTA OPTICA SINICA, 2021, 41 (04)
  • [3] Accurate and Robust RGB-D Visual Odometry Based on Point and Line Features
    Zhao, Guojie
    Zhang, Yupeng
    Liu, Peichu
    Wu, Haoen
    Cui, Mingyang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2021, PT II, 2021, 12816 : 500 - 510
  • [4] A robust visual odometry based on RGB-D camera in dynamic indoor environments
    Zhang, Fangfang
    Li, Qiyan
    Wang, Tingting
    Ma, Tianlei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2021, 32 (04)
  • [5] Dynamic RGB-D Visual Odometry
    Yang, Dongsheng
    Bi, Shusheng
    Cai, Yueri
    Zheng, Jingxiang
    Yuan, Chang
    2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 941 - 946
  • [6] Maximum Clique based RGB-D Visual Odometry
    Zhang, Yigong
    Hou, Zhixing
    Yang, Jian
    Kong, Hui
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2764 - 2769
  • [7] An Adaptive Visual Odometry Based on RGB-D Sensors
    Zheng, Enhui
    Wang, Tantan
    Liu, Zheng
    Xu, Ling
    2019 4TH INTERNATIONAL CONFERENCE ON ELECTROMECHANICAL CONTROL TECHNOLOGY AND TRANSPORTATION (ICECTT 2019), 2019, : 154 - 158
  • [8] Bi-objective Optimization for Robust RGB-D Visual Odometry
    Han, Tao
    Xu, Chao
    Loxton, Ryan
    Xie, Lei
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1837 - 1844
  • [9] Robust RGB-D Visual Odometry Using Point and Line Features
    Sun, Chao
    Qiao, Nianzu
    Ge, Wei
    Sun, Jia
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3826 - 3831
  • [10] Robust Visual Odometry to Irregular Illumination Changes with RGB-D camera
    Kim, Pyojin
    Lim, Hyon
    Kim, H. Jin
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 3688 - 3694