ContourPose: Monocular 6-D Pose Estimation Method for Reflective Textureless Metal Parts

被引:5
|
作者
He, Zaixing [1 ]
Li, Quanzhi [1 ]
Zhao, Xinyue [1 ]
Wang, Jin [1 ]
Shen, Huarong [2 ]
Zhang, Shuyou [1 ]
Tan, Jianrong [1 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310058, Peoples R China
[2] Zhejiang Feihang Intelligent Technol Co Ltd, Huzhou 313200, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; reflective textureless metal parts; six degrees of freedom (6-D) pose estimation;
D O I
10.1109/TRO.2023.3290300
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Pose estimation is an essential technology for industrial robots to perform precise gripping and assembly. The state-of-the-art deep learning-based approach uses an indirect strategy, i.e., first finding local correspondence between the 2-D image and 3-D model, and then using the perspective-n-point and RANSAC methods to calculate the poses of ordinary objects. However, the metal parts in industry are reflective and textureless, making it difficult to identify distinguishable point features to establish 2-D-3-D correspondences. To address this problem, in this article, we propose a novel deep learning based two-stage method for pose estimation of reflective textureless metal parts, which accurately estimates the target pose using monocular red green blue (RGB) images. Since contours play an important role in both keypoints prediction and pose estimation stages, our method is named ContourPose. First, an additional contour decoder is adopted to implicitly constrain the keypoints prediction in the former stage, which improves the accuracy of the keypoints prediction. Then, the predicted contour of the previous stage is taken as geometric prior that is used to iteratively solve for the optimal pose. Experiments indicate that the proposed approach for reflective textureless metal parts has a significant improvement over the state-of-the-art approaches.
引用
收藏
页码:4037 / 4050
页数:14
相关论文
共 50 条
  • [1] WireframePose: Monocular 6-D Pose Estimation of Metal Parts Based on Wireframe Extraction and Matching
    Liu, Ze'An
    Wang, Xuanyin
    Pu, Bin
    Tang, Jixiang
    Sun, Jiaqi
    IEEE Transactions on Instrumentation and Measurement, 2024, 73
  • [2] Sparse Template-Based 6-D Pose Estimation of Metal Parts Using a Monocular Camera
    He, Zaixing
    Jiang, Zhiwei
    Zhao, Xinyue
    Zhang, Shuyou
    Wu, Chenrui
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (01) : 390 - 401
  • [3] Challenges for Monocular 6-D Object Pose Estimation in Robotics
    Thalhammer, Stefan
    Bauer, Dominik
    Hoenig, Peter
    Weibel, Jean-Baptiste
    Garcia-Rodriguez, Jose
    Vincze, Markus
    IEEE TRANSACTIONS ON ROBOTICS, 2024, 40 : 4065 - 4084
  • [4] Pseudo-Siamese Graph Matching Network for Textureless Objects' 6-D Pose Estimation
    Wu, Chenrui
    Chen, Long
    He, Zaixing
    Jiang, Junjie
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (03) : 2718 - 2727
  • [5] 6-D pose estimation method for large gear structure assembly using monocular vision
    Zhou, Kuai
    Huang, Xiang
    Li, Shuanggao
    Li, Hangyu
    Kong, Shengjie
    MEASUREMENT, 2021, 183
  • [6] MODELING AND INTERPRETING 6-D OBJECT POSE ESTIMATION
    Soler, Diego
    Hirata, Roberto, Jr.
    Espadoto, Mateus
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2325 - 2329
  • [8] A Practical Robotic Grasping Method by Using 6-D Pose Estimation With Protective Correction
    Zhang, Hui
    Liang, Zhicong
    Li, Chen
    Zhong, Hang
    Liu, Li
    Zhao, Chenyang
    Wang, Yaonan
    Wu, Q. M. Jonathan
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (04) : 3876 - 3886
  • [9] Active 6-D position-pose estimation of a spatial circle using monocular eye-in-hand system
    Ma, Xin
    Feng, Junbing
    Li, Yibin
    Tan, Jindong
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2018, 15 (01):
  • [10] Robust 6-D Pose Estimation of the UAV Based on Hybrid Features
    Li, Chujun
    Wu, Yiyang
    Zhuge, Sheng
    Yang, Xia
    Lin, Bin
    Xu, Xiangpeng
    Zhang, Xiaohu
    IEEE Transactions on Instrumentation and Measurement, 2024, 73