6D Pose Estimation Based on 3D Edge Binocular Reprojection Optimization for Robotic Assembly

被引:1
|
作者
Li, Dong [1 ]
Mu, Quan [2 ]
Yuan, Yilin [1 ]
Wu, Shiwei [1 ]
Tian, Ye [1 ]
Hong, Hualin [1 ]
Jiang, Qian [1 ]
Liu, Fei [1 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss, Chongqing 400000, Peoples R China
[2] Minist Ecol & Environm, Foreign Environm Cooperat Ctr, Beijing 100035, Peoples R China
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Pose estimation; Image edge detection; Feature extraction; Optimization; Solid modeling; Robots; 6D pose estimation; pose refinement; robotic assembly;
D O I
10.1109/LRA.2023.3327933
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Accurate 6D pose estimation of object is important for robot assembly. This letter presents a novel method for achieving high precision 6D pose estimation by exploiting the reprojection of 3D edges onto binocular RGB image pairs. Our proposed method encompasses three phases: detection, pose initialization, and pose refinement. In the detection phase, an existing detector is employed to identify the objects within the image pairs. Subsequently, the object image patch of interest is extracted and fed into an encoder-decoder network that leverages edge maps and RGB images for the purpose of initial pose estimation. To refine the initial pose and achieve precise 6D pose estimation, we introduce a novel binocular edge-map-based nonlinear optimization technique. Our primary contributions entail an improved initial pose estimation network and a novel pose optimization technique. The improved network is dedicated to enhancing the accuracy of initial pose estimation, while the optimization technique focuses on refining the precision of the estimations. Experimental results demonstrate the effectiveness of our method, yielding an average translation precision of 0.48 mm and rotation precision of 0.45 degrees. Consequently, our proposed method can be seamlessly integrated into robotic manipulation platforms to successfully execute diverse assembly tasks.
引用
收藏
页码:8319 / 8326
页数:8
相关论文
共 50 条
  • [1] Reconstruction-based 6D pose estimation for robotic assembly
    Shi, Zhongchen
    Xu, Kai
    Li, Zhang
    Guan, Banglei
    Wang, Gang
    Shang, Yang
    [J]. APPLIED OPTICS, 2020, 59 (31) : 9824 - 9835
  • [2] Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation
    Hagelskjaer, Frederik
    Kruger, Norbert
    Buch, Anders
    [J]. PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 135 - 142
  • [3] 6D Robotic Assembly Based on RGB-only Object Pose Estimation
    Fu, Bowen
    Leong, Sek Kun
    Lian, Xiaocong
    Ji, Xiangyang
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 4736 - 4742
  • [4] 6D Pose Estimation for Precision Assembly
    Skeik, Ola
    Erden, Mustafa Suphi
    Kong, Xianwen
    [J]. 2022 IEEE 5TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING APPLICATIONS AND SYSTEMS, IPAS, 2022,
  • [5] Fast 6D object pose estimation of shell parts for robotic assembly
    Haopeng Hu
    Weikun Gu
    Xiansheng Yang
    Nan Zhang
    Yunjiang Lou
    [J]. The International Journal of Advanced Manufacturing Technology, 2022, 118 : 1383 - 1396
  • [6] Fast 6D object pose estimation of shell parts for robotic assembly
    Hu, Haopeng
    Gu, Weikun
    Yang, Xiansheng
    Zhang, Nan
    Lou, Yunjiang
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 118 (5-6): : 1383 - 1396
  • [7] Binocular vision object 6D pose estimation based on circulatory neural network
    Yang, Heng
    Li, Zhuo
    Kang, Zhong-Yuan
    Tian, Bing
    Dong, Qing
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (11): : 2179 - 2187
  • [8] Weakly Supervised 6D Pose Estimation for Robotic Grasping
    Li, Yaoxin
    Sun, Jinghua
    Li, Xiaoqian
    Zhang, Zhanpeng
    Cheng, Hui
    Wang, Xiaogang
    [J]. PROCEEDINGS OF THE 16TH ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY (VRCAI 2018), 2018,
  • [9] 6D pose estimation and 3D object reconstruction from 2D shape for robotic grasping of objects
    Wolnitza, Marcell
    Kaya, Osman
    Kulvicius, Tomas
    Woergoetter, Florentin
    Dellen, Babette
    [J]. 2022 SIXTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING, IRC, 2022, : 67 - 71
  • [10] Point Pair Feature based 6D pose estimation for robotic grasping
    Fu, Hejie
    Mei, XueSong
    Zhang, Zhaohui
    Zhao, Wanqiu
    Yang, Jun
    [J]. PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 1803 - 1808