Texture-less object detection and 6D pose estimation in RGB-D images

被引:22
|
作者
Zhang, Haoruo [1 ]
Cao, Qixin [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Texture-less object; 6D pose estimation; RGB-D; Rendered template; Hash voting; Particle swarm optimization;
D O I
10.1016/j.robot.2017.06.003
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a cascade-like texture-less object detection and 6D pose estimation method exploiting both depth and color information from the RGB-D sensor. This is accomplished through both an offline and online phase. During the offline phase, a set of rendered templates is created from uniformly distributed sampling viewpoints obtained by employing the model of electrostatic charge distribution. During the online phase, our method converts sliding windows to scale-invariant RGB-D patches and employs a hash voting-based hypothesis generation scheme to compute a rough 6D pose hypothesis. Particle swarm optimization is employed to refine the 6D pose of the target object. We evaluate the algorithm against three datasets with the result that this method achieves high precision and good performance under various conditions. It was also applied to augmented reality and intelligent robotic manipulation yielding robust detection results. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:64 / 79
页数:16
相关论文
共 50 条
  • [1] T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objects
    Hodan, Tomas
    Haluza, Pavel
    Obdrzalek, Stepan
    Matas, Jiri
    Lourakis, Manolis
    Zabulis, Xenophon
    [J]. 2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, : 880 - 888
  • [2] Detection and Fine 3D Pose Estimation of Texture-less Objects in RGB-D Images
    Hodan, Tomas
    Zabulis, Xenophon
    Lourakis, Manolis
    Obdrzalek, Stepan
    Matas, Jiri
    [J]. 2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 4421 - 4428
  • [3] Fast 6D Pose Estimation for Texture-less Objects from a single RGB image
    Muoz, E.
    Konishi, Y.
    Murino, V.
    Del Bue, A.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2016, : 5623 - 5630
  • [4] Holistic and local patch framework for 6D object pose estimation in RGB-D images
    Zhang, Haoruo
    Cao, Qixin
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 180 : 59 - 73
  • [5] 6D Pose Estimation for Texture-Less Industrial Parts in the Crowd
    Zhou, Dexin
    Chai, Ziqi
    Liu, Chao
    Li, Peng
    Xiong, Zhenhua
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, 2020, 12595 : 415 - 428
  • [6] Detect in RGB, Optimize in Edge: Accurate 6D Pose Estimation for Texture-less Industrial Parts
    Zhang, Haoruo
    Cao, Qixin
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 3486 - 3492
  • [7] Robust 6D Object Pose Estimation by Learning RGB-D Features
    Tian, Meng
    Pan, Liang
    Ang, Marcelo H., Jr.
    Lee, Gim Hee
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6218 - 6224
  • [8] Dense Color Constraints based 6D object pose estimation from RGB-D images
    Wang, Zilun
    Liu, Yi
    Xu, Chi
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6416 - 6420
  • [9] 3D Object Detection and 6D Pose Estimation Using RGB-D Images and Mask R-CNN
    Tran, Van Luan
    Lin, Huei-Yung
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2020,
  • [10] A RGB-D feature fusion network for occluded object 6D pose estimation
    Song, Yiwei
    Tang, Chunhui
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (8-9) : 6309 - 6319