CPPF plus plus : Uncertainty-Aware Sim2Real Object Pose Estimation by Vote Aggregation

被引:0
|
作者
You, Yang [1 ,2 ]
He, Wenhao [3 ]
Liu, Jin [1 ]
Xiong, Hongkai [1 ]
Wang, Weiming [1 ]
Lu, Cewu [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai 200240, Peoples R China
[2] Stanford Univ, Stanford, CA 94305 USA
[3] Flexiv Robot Inc, Shanghai 201100, Peoples R China
基金
中国国家自然科学基金;
关键词
Object pose estimation; sim-to-real transfer; point-pair features; dataset creation;
D O I
10.1109/TPAMI.2024.3419038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Object pose estimation constitutes a critical area within the domain of 3D vision. While contemporary state-of-the-art methods that leverage real-world pose annotations have demonstrated commendable performance, the procurement of such real training data incurs substantial costs. This paper focuses on a specific setting wherein only 3D CAD models are utilized as a priori knowledge, devoid of any background or clutter information. We introduce a novel method, CPPF++, designed for sim-to-real category-level pose estimation. This method builds upon the foundational point-pair voting scheme of CPPF, reformulating it through a probabilistic view. To address the challenge posed by vote collision, we propose a novel approach that involves modeling the voting uncertainty by estimating the probabilistic distribution of each point pair within the canonical space. Furthermore, we augment the contextual information provided by each voting unit through the introduction of N-point tuples. To enhance the robustness and accuracy of the model, we incorporate several innovative modules, including noisy pair filtering, online alignment optimization, and a tuple feature ensemble. Alongside these methodological advancements, we introduce a new category-level pose estimation dataset, named DiversePose 300. Empirical evidence demonstrates that our method significantly surpasses previous sim-to-real approaches and achieves comparable or superior performance on novel datasets.
引用
收藏
页码:9239 / 9254
页数:16
相关论文
共 7 条
  • [1] Sim2Real Grasp Pose Estimation for Adaptive Robotic Applications
    Horvath, Daniel
    Bocsi, Kristof
    Erdos, Gabor
    Istenes, Zoltan
    IFAC PAPERSONLINE, 2023, 56 (02): : 5233 - 5239
  • [2] Symmetry and Uncertainty-Aware Object SLAM for 6DoF Object Pose Estimation
    Merrill, Nathaniel
    Guo, Yuliang
    Zuo, Xingxing
    Huang, Xinyu
    Leutenegger, Stefan
    Peng, Xi
    Ren, Liu
    Huang, Guoquan
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14881 - 14890
  • [3] TGF-Net: Sim2Real Transparent Object 6D Pose Estimation Based on Geometric Fusion
    Yu, Haixin
    Li, Shoujie
    Liu, Houde
    Xia, Chongkun
    Ding, Wenbo
    Liang, Bin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06): : 3867 - 3874
  • [4] Sim2real transfer learning for 3D human pose estimation: motion to the rescue
    Doersch, Carl
    Zisserman, Andrew
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [5] Sim2Real Instance-Level Style Transfer for 6D Pose Estimation
    Ikeda, Takuya
    Tanishige, Suomi
    Amma, Ayako
    Sudano, Michael
    Audren, Herv Prime E.
    Nishiwaki, Koichi
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 3225 - 3232
  • [6] Dual-COPE: A novel prior-based category-level object pose estimation network with dual Sim2Real unsupervised domain adaptation module
    Ren, Xi
    Guo, Nan
    Zhu, Zichen
    Jiang, Xinbei
    COMPUTERS & GRAPHICS-UK, 2024, 124
  • [7] D-SPDH: Improving 3D Robot Pose Estimation in Sim2Real Scenario via Depth Data
    Simoni, Alessandro
    Borghi, Guido
    Garattoni, Lorenzo
    Francesca, Gianpiero
    Vezzani, Roberto
    IEEE ACCESS, 2024, 12 : 166660 - 166673