6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:5
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [31] On Evaluation of 6D Object Pose Estimation
    Hodan, Tomas
    Matas, Jiri
    Obdrzalek, Stephan
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 606 - 619
  • [32] Confidence-Based 6D Object Pose Estimation
    Huang, Wei-Lun
    Hung, Chun-Yi
    Lin, I-Chen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3025 - 3035
  • [33] 6D Object Pose Estimation Based on the Attention Mechanism
    Zhou, Guanyu
    INTERNATIONAL CONFERENCE ON ALGORITHMS, HIGH PERFORMANCE COMPUTING, AND ARTIFICIAL INTELLIGENCE (AHPCAI 2021), 2021, 12156
  • [34] 6D Pose Estimation with Correlation Fusion
    Cheng, Yi
    Zhu, Hongyuan
    Sun, Ying
    Acar, Cihan
    Jing, Wei
    Wu, Yan
    Li, Liyuan
    Tan, Cheston
    Lim, Joo-Hwee
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2988 - 2994
  • [35] Anchor-Based 6D Object Pose Estimation
    Liu, Zehao
    Wang, Hao
    Liu, Fuchang
    2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 33 - 40
  • [36] A novel metric for 6D pose estimation
    Niedermaier, Tobias
    Berens, Felix
    Reischl, Markus
    Elser, Stefan
    AT-AUTOMATISIERUNGSTECHNIK, 2025, 73 (02) : 125 - 135
  • [37] 3D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimation
    Zhou, Guangyao
    Gothoskar, Nishad
    Wang, Lirui
    Tenenbaum, Joshua B.
    Gutfreund, Dan
    Lazaro-Gredilla, Miguel
    George, Dileep
    Mansinghka, Vikash K.
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21568 - 21579
  • [38] CorNet: Generic 3D Corners for 6D Pose Estimation of New Objects without Retraining
    Pitteri, Giorgia
    Ilic, Slobodan
    Lepeutit, Vincent
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2807 - 2815
  • [39] Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud
    Guo, Jianwei
    Xing, Xuejun
    Quan, Weize
    Yan, Dong-Ming
    Gu, Qingyi
    Liu, Yang
    Zhang, Xiaopeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5072 - 5084
  • [40] Hybrid Feature Based 6D Pose Tracking under Binocular Vision for Automated Micro-assembly
    Xie, Tianyu
    Zhang, Xianmin
    Li, Hai
    Zhang, Jianqin
    2023 9TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND ROBOTICS ENGINEERING, ICMRE, 2023, : 112 - 117