Refined Prior Guided Category-Level 6D Pose Estimation and Its Application on Robotic Grasping

被引:0
|
作者
Sun, Huimin [1 ]
Zhang, Yilin [1 ]
Sun, Honglin [1 ]
Hashimoto, Kenji [1 ]
机构
[1] Waseda Univ, Grad Sch Informat Prod & Syst, Kitakyushu 8080135, Japan
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 17期
关键词
pose estimation; robotic grasping; grasp detection; channel attention; scene understanding;
D O I
10.3390/app14178009
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Estimating the 6D pose and size of objects is crucial in the task of visual grasping for robotic arms. Most current algorithms still require the 3D CAD model of the target object to match with the detected points, and they are unable to predict the object's size, which significantly limits the generalizability of these methods. In this paper, we introduce category priors and extract high-dimensional abstract features from both the observed point cloud and the prior to predict the deformation matrix of the reconstructed point cloud and the dense correspondence between the reconstructed and observed point clouds. Furthermore, we propose a staged geometric correction and dense correspondence refinement mechanism to enhance the accuracy of regression. In addition, a novel lightweight attention module is introduced to further integrate the extracted features and identify potential correlations between the observed point cloud and the category prior. Ultimately, the object's translation, rotation, and size are obtained by mapping the reconstructed point cloud to a normalized canonical coordinate system. Through extensive experiments, we demonstrate that our algorithm outperforms existing methods in terms of performance and accuracy on commonly used benchmarks for this type of problem. Additionally, we implement the algorithm in robotic arm-grasping simulations, further validating its effectiveness.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanism
    Chen, Wei
    Jia, Xi
    Chang, Hyung Jin
    Duan, Jinming
    Shen, Linlin
    Leonardis, Ales
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1581 - 1590
  • [42] CatTrack: Single-Stage Category-Level 6D Object Pose Tracking via Convolution and Vision Transformer
    Yu, Sheng
    Zhai, Di-Hua
    Xia, Yuanqing
    Li, Dong
    Zhao, Shiqi
    [J]. IEEE Transactions on Multimedia, 2024, 26 : 1665 - 1680
  • [43] SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations
    Wan, Boyan
    Shi, Yifei
    Xu, Kai
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14019 - 14028
  • [44] CatTrack: Single-Stage Category-Level 6D Object Pose Tracking via Convolution and Vision Transformer
    Yu, Sheng
    Zhai, Di-Hua
    Xia, Yuanqing
    Li, Dong
    Zhao, Shiqi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1665 - 1680
  • [45] Prior-information-guided corresponding point regression network for 6D pose estimation
    Gan, Haiqing
    Wang, Lihui
    Su, Yuzuwei
    Ruan, Wenjun
    Jiao, Xize
    [J]. COMPUTERS & GRAPHICS-UK, 2024, 121
  • [46] Prior Geometry Guided Direct Regression Network for Monocular 6D Object Pose Estimation
    Liu, Chongpei
    Sun, Wei
    Zhang, Keyi
    Liu, Jian
    Zhang, Xing
    Fan, Shimeng
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6241 - 6246
  • [47] Query6DoF: Learning Sparse Queries as Implicit Shape Prior for Category-Level 6DoF Pose Estimation
    Wang, Ruiqi
    Wang, Xinggang
    Li, Te
    Yang, Rong
    Wan, Minhong
    Liu, Wenyu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14009 - 14018
  • [48] Optimal Pose and Shape Estimation for Category-level 3D Object Perception
    Shi, Jingnan
    Yang, Heng
    Carlone, Luca
    [J]. ROBOTICS: SCIENCE AND SYSTEM XVII, 2021,
  • [49] KPA-Tracker: Towards Robust and Real-Time Category-Level Articulated Object 6D Pose Tracking
    Liu, Liu
    Huang, Anran
    Wu, Qi
    Guo, Dan
    Yang, Xun
    Wang, Meng
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3684 - 3692
  • [50] SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimation
    Zhang, Ruida
    Di, Yan
    Manhardt, Fabian
    Tombari, Federico
    Ji, Xiangyang
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 7452 - 7459