GeoPose: Dense Reconstruction Guided 6D Object Pose Estimation With Geometric Consistency

被引:5
|
作者
Wang, Deming [1 ]
Zhou, Guangliang [1 ]
Yan, Yi [1 ]
Chen, Huiyi [2 ]
Chen, Qijun [1 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, 4800 Caon Highway, Shanghai 201804, Peoples R China
[2] Tisch Sch Arts Univ, New York, NY 10003 USA
基金
中国国家自然科学基金;
关键词
6D object pose estimation; reconstruction guidance; dense 2D-3D correspondences; geometric consistency; DESCRIPTORS;
D O I
10.1109/TMM.2021.3117092
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
6D object pose estimation for texture-less objects from RGB images remains challenging, especially in occlusion scenarios. Instead of localizing sparse keypoints by regressing their image coordinates or heatmaps, which are sensitive to occlusion, we introduce GeoPose, a novel reconstruction guided pose estimation pipeline that predicts dense correspondences and leverages geometric consistency effectively. We first design a dense reconstruction network (ReconNet) to reconstruct pixel-wise object coordinates in normalization space. Dense 2D-3D correspondences are generated intuitively by our explicit parameterization for 3D object models, which dismisses keypoint selection efforts. These 2D-3D correspondences are then utilized to estimate 6D poses by the PnP algorithm with RANSAC iterations. Furthermore, a novel Cycle Loss is proposed to provide 3D prior supervision, which significantly correlates with the pose estimation task by guiding geometric consistency between reconstruction (pixel to 3D) and reprojection (3D to pixel). In addition, a training data augmentation method is proposed to handle the insufficiency of 6D datasets, the acquisition of which is error-prone and time-consuming. Extensive experiments demonstrate that, compared with existing RGB-based methods, our GeoPose can achieve state-of-the-art (SOTA) 6D pose estimation performance on the LINEMOD, Occlusion LINEMOD and T-LESS datasets.
引用
收藏
页码:4394 / 4408
页数:15
相关论文
共 50 条
  • [31] Anchor-Based 6D Object Pose Estimation
    Liu, Zehao
    Wang, Hao
    Liu, Fuchang
    [J]. 2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 33 - 40
  • [32] PointPoseNet: Point Pose Network for Robust 6D Object Pose Estimation
    Chen, Wei
    Duan, Jinming
    Basevi, Hector
    Chang, Hyung Jin
    Leonardis, Ales
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2813 - 2822
  • [33] A Pose Proposal and Refinement Network for Better 6D Object Pose Estimation
    Trabelsi, Ameni
    Chaabane, Mohamed
    Blanchard, Nathaniel
    Beveridge, Ross
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2381 - 2390
  • [34] Prior Geometry Guided Direct Regression Network for Monocular 6D Object Pose Estimation
    Liu, Chongpei
    Sun, Wei
    Zhang, Keyi
    Liu, Jian
    Zhang, Xing
    Fan, Shimeng
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6241 - 6246
  • [35] Dense Color Constraints based 6D object pose estimation from RGB-D images
    Wang, Zilun
    Liu, Yi
    Xu, Chi
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6416 - 6420
  • [36] Spatial and temporal consistency learning for monocular 6D pose estimation
    Zhang, Hong-Bo
    Liang, Jia-Yu
    Hong, Jia-Xin
    Lei, Qing
    Liu, Jing-Hua
    Du, Ji-Xiang
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [37] Introducing Pose Consistency and Warp-Alignment for Self-Supervised 6D Object Pose Estimation in Color Images
    Sock, Juil
    Garcia-Hernando, Guillermo
    Armagan, Anil
    Kim, Tae-Kyun
    [J]. 2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 291 - 300
  • [38] DoPose-6D dataset for object segmentation and 6D pose estimation
    Gouda, Anas
    Ghanem, Abraham
    Reining, Christopher
    [J]. 2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 477 - 483
  • [39] ConvPoseCNN2: Prediction and Refinement of Dense 6D Object Pose
    Periyasamy, Arul Selvam
    Capellen, Catherine
    Schwarz, Max
    Behnke, Sven
    [J]. COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VISIGRAPP 2020, 2022, 1474 : 353 - 371
  • [40] ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimation
    Fan, Zhaoxin
    Song, Zhenbo
    Wang, Zhicheng
    Xu, Jian
    Wu, Kejian
    Liu, Hongyan
    He, Jun
    [J]. PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 55 - 63