GeoPose: Dense Reconstruction Guided 6D Object Pose Estimation With Geometric Consistency

被引:5
|
作者
Wang, Deming [1 ]
Zhou, Guangliang [1 ]
Yan, Yi [1 ]
Chen, Huiyi [2 ]
Chen, Qijun [1 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, 4800 Caon Highway, Shanghai 201804, Peoples R China
[2] Tisch Sch Arts Univ, New York, NY 10003 USA
基金
中国国家自然科学基金;
关键词
6D object pose estimation; reconstruction guidance; dense 2D-3D correspondences; geometric consistency; DESCRIPTORS;
D O I
10.1109/TMM.2021.3117092
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
6D object pose estimation for texture-less objects from RGB images remains challenging, especially in occlusion scenarios. Instead of localizing sparse keypoints by regressing their image coordinates or heatmaps, which are sensitive to occlusion, we introduce GeoPose, a novel reconstruction guided pose estimation pipeline that predicts dense correspondences and leverages geometric consistency effectively. We first design a dense reconstruction network (ReconNet) to reconstruct pixel-wise object coordinates in normalization space. Dense 2D-3D correspondences are generated intuitively by our explicit parameterization for 3D object models, which dismisses keypoint selection efforts. These 2D-3D correspondences are then utilized to estimate 6D poses by the PnP algorithm with RANSAC iterations. Furthermore, a novel Cycle Loss is proposed to provide 3D prior supervision, which significantly correlates with the pose estimation task by guiding geometric consistency between reconstruction (pixel to 3D) and reprojection (3D to pixel). In addition, a training data augmentation method is proposed to handle the insufficiency of 6D datasets, the acquisition of which is error-prone and time-consuming. Extensive experiments demonstrate that, compared with existing RGB-based methods, our GeoPose can achieve state-of-the-art (SOTA) 6D pose estimation performance on the LINEMOD, Occlusion LINEMOD and T-LESS datasets.
引用
收藏
页码:4394 / 4408
页数:15
相关论文
共 50 条
  • [1] Learning latent geometric consistency for 6D object pose estimation in heavily cluttered scenes
    Li, Qingnan
    Hu, Ruimin
    Xiao, Jing
    Wang, Zhongyuan
    Chen, Yu
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 70
  • [2] ConvPoseCNN: Dense Convolutional 6D Object Pose Estimation
    Capellen, Catherine
    Schwarz, Max
    Behnke, Sven
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 162 - 172
  • [3] DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
    Wang, Chen
    Xu, Danfei
    Zhu, Yuke
    Martin-Martin, Roberto
    Lu, Cewu
    Li Fei-Fei
    Savarese, Silvio
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3338 - 3347
  • [4] ACCURATE 6D OBJECT POSE ESTIMATION BY POSE CONDITIONED MESH RECONSTRUCTION
    Castro, Pedro
    Armagan, Anil
    Kim, Tae-Kyun
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4147 - 4151
  • [5] 6D Object Pose Estimation with Pairwise Compatible Geometric Features
    Lin, Muyuan
    Murali, Varun
    Karaman, Sertac
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 10966 - 10973
  • [6] Multi Task-Guided 6D Object Pose Estimation
    Thu-Uyen Nguyen
    Van-Duc Vu
    Van-Thiep Nguyen
    Ngoc-Anh Hoang
    Duy-Quang Vu
    Duc-Thanh Tran
    Khanh-Toan Phan
    Anh-Truong Mai
    Van-Hiep Duong
    Cong-Trinh Chan
    Ngoc-Trung Ho
    Quang-Tri Duong
    Phuc-Quan Ngo
    Dinh-Cuong Hoang
    [J]. PROCEEDINGS OF THE 2024 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION TECHNOLOGY, ICIIT 2024, 2024, : 215 - 222
  • [7] Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation
    Corsetti, Jaime
    Boscaini, Davide
    Poiesi, Fabio
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 2095 - 2104
  • [8] On Evaluation of 6D Object Pose Estimation
    Hodan, Tomas
    Matas, Jiri
    Obdrzalek, Stephan
    [J]. COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 606 - 619
  • [9] Learning geometric consistency and discrepancy for category-level 6D object pose estimation from point clouds
    Zou, Lu
    Huang, Zhangjin
    Gu, Naijie
    Wang, Guoping
    [J]. PATTERN RECOGNITION, 2024, 145
  • [10] Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation
    Hai, Yang
    Song, Rui
    Li, Jiaojiao
    Ferstl, David
    Hu, Yinlin
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14029 - 14039