Learning geometric consistency and discrepancy for category-level 6D object pose estimation from point clouds

被引:1
|
作者
Zou, Lu [1 ]
Huang, Zhangjin [1 ,2 ,3 ]
Gu, Naijie [1 ,2 ]
Wang, Guoping [4 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Peoples R China
[2] Anhui Prov Key Lab Software Comp & Commun, Hefei 230027, Peoples R China
[3] USTC, Deqing Alpha Innovat Res Inst, Huzhou 313299, Peoples R China
[4] Peking Univ, Beijing 100871, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
6D object pose estimation; 3D object detection; Point cloud processing; Shape recovery;
D O I
10.1016/j.patcog.2023.109896
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Category-level 6D object pose estimation aims to predict the position and orientation of unseen object instances, which is a fundamental problem in robotic applications. Previous works mainly focused on exploiting visual cues from RGB images, while depth images received less attention. However, depth images contain rich geometric attributes about the object's shape, which are crucial for inferring the object's pose. This work achieves category-level 6D object pose estimation by performing sufficient geometric learning from depth images represented by point clouds. Specifically, we present a novel geometric consistency and geometric discrepancy learning framework called CD-Pose to resolve the intra-category variation, inter-category similarity, and objects with complex structures. Our network consists of a Pose-Consistent Module and a Pose-Discrepant Module. First, a simple MLP-based Pose-Consistent Module is utilized to extract geometrically consistent pose features of objects from the pre-computed object shape priors for each category. Then, the Pose Discrepant Module, designed as a multi-scale region-guided transformer network, is dedicated to exploring each instance's geometrically discrepant features. Next, the NOCS model of the object is reconstructed according to the integration of consistent and discrepant geometric representations. Finally, 6D object poses are obtained by solving the similarity transformation between the reconstruction and the observed point cloud. Experiments on the benchmark datasets show that our CD-Pose produces superior results to state-of-the-art competitors.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Category-Level Object Pose Estimation with Statistic Attention
    Jiang, Changhong
    Mu, Xiaoqiao
    Zhang, Bingbing
    Liang, Chao
    Xie, Mujun
    [J]. SENSORS, 2024, 24 (16)
  • [32] Robust Category-Level 6D Pose Estimation with Coarse-to-Fine Rendering of Neural Features
    Ma, Wufei
    Wang, Angtian
    Yuille, Alan
    Kortylewski, Adam
    [J]. COMPUTER VISION, ECCV 2022, PT IX, 2022, 13669 : 492 - 508
  • [33] SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations
    Wan, Boyan
    Shi, Yifei
    Xu, Kai
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14019 - 14028
  • [34] Category-Level Articulated Object 9D Pose Estimation via Reinforcement Learning
    Liu, Liu
    Du, Jianming
    Wu, Hao
    Yang, Xun
    Liu, Zhenguang
    Hong, Richang
    Wang, Meng
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 728 - 736
  • [35] Refined Prior Guided Category-Level 6D Pose Estimation and Its Application on Robotic Grasping
    Sun, Huimin
    Zhang, Yilin
    Sun, Honglin
    Hashimoto, Kenji
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [36] A Visual Navigation Perspective for Category-Level Object Pose Estimation
    Guo, Jiaxin
    Zhong, Fangxun
    Xiong, Rong
    Liu, Yunhui
    Wang, Yue
    Liao, Yiyi
    [J]. COMPUTER VISION - ECCV 2022, PT VI, 2022, 13666 : 123 - 141
  • [37] iCaps: Iterative Category-Level Object Pose and Shape Estimation
    Deng, Xinke
    Geng, Junyi
    Bretl, Timothy
    Xiang, Yu
    Fox, Dieter
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 1784 - 1791
  • [38] Zero-Shot Category-Level Object Pose Estimation
    Goodwin, Walter
    Vaze, Sagar
    Havoutis, Ioannis
    Posner, Ingmar
    [J]. COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 516 - 532
  • [39] Category-Level Metric Scale Object Shape and Pose Estimation
    Lee, Taeyeop
    Lee, Byeong-Uk
    Kim, Myungchul
    Kweon, I. S.
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 8575 - 8582
  • [40] Category-Level 6-D Object Pose Estimation With Shape Deformation for Robotic Grasp Detection
    Yu, Sheng
    Zhai, Di-Hua
    Guan, Yuyin
    Xia, Yuanqing
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15