Learning 6D Object Pose Estimation Using 3D Object Coordinates

被引:0
|
作者
Brachmann, Eric [1 ]
Krull, Alexander [1 ]
Michel, Frank [1 ]
Gumhold, Stefan [1 ]
Shotton, Jamie [2 ]
Rother, Carsten [1 ]
机构
[1] Tech Univ Dresden, Dresden, Germany
[2] Microsoft Res, Cambridge, England
来源
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work addresses the problem of estimating the 6D Pose of specific objects from a single RGB-D image. We present a flexible approach that can deal with generic objects, both textured and texture-less. The key new concept is a learned, intermediate representation in form of a dense 3D object coordinate labelling paired with a dense class labelling. We are able to show that for a common dataset with texture-less objects, where template-based techniques are suitable and state of the art, our approach is slightly superior in terms of accuracy. We also demonstrate the benefits of our approach, compared to template-based techniques, in terms of robustness with respect to varying lighting conditions. Towards this end, we contribute a new ground truth dataset with 10k images of 20 objects captured each under three different lighting conditions. We demonstrate that our approach scales well with the number of objects and has capabilities to run fast.
引用
收藏
页码:536 / 551
页数:16
相关论文
共 50 条
  • [1] A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning
    Hoque, Sabera
    Arafat, Md. Yasir
    Xu, Shuxiang
    Maiti, Ananda
    Wei, Yuchen
    [J]. IEEE ACCESS, 2021, 9 : 143746 - 143770
  • [2] On Evaluation of 6D Object Pose Estimation
    Hodan, Tomas
    Matas, Jiri
    Obdrzalek, Stephan
    [J]. COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 606 - 619
  • [3] Towards Learning 3d Object Detection and 6d Pose Estimation from Synthetic Data
    Rudorfer, Martin
    Neumann, Lukas
    Krueger, Joerg
    [J]. 2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1540 - 1543
  • [4] SO(3)-Pose: SO(3)-Equivariance Learning for 6D Object Pose Estimation
    Pan, Haoran
    Zhou, Jun
    Liu, Yuanpeng
    Lu, Xuequan
    Wang, Weiming
    Yan, Xuefeng
    Wei, Mingqiang
    [J]. COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 371 - 381
  • [5] Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
    Kehl, Wadim
    Milletari, Fausto
    Tombari, Federico
    Ilic, Slobodan
    Navab, Nassir
    [J]. COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 205 - 220
  • [6] Single Shot 6D Object Pose Estimation
    Kleeberger, Kilian
    Huber, Marco F.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6239 - 6245
  • [7] BOP: Benchmark for 6D Object Pose Estimation
    Hodan, Tomas
    Michel, Frank
    Brachmann, Eric
    Kehl, Wadim
    Buch, Anders Glent
    Kraft, Dirk
    Drost, Bertram
    Vidal, Joel
    Ihrke, Stephan
    Zabulis, Xenophon
    Sahin, Caner
    Manhardt, Fabian
    Tombari, Federico
    Kim, Tae-Kyun
    Matas, Jiri
    Rother, Carsten
    [J]. COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 19 - 35
  • [8] 6D Object Pose Estimation from Approximate 3D Models for Orbital Robotics
    Ulmer, Maximilian
    Durner, Maximilian
    Sundermeyer, Martin
    Stoiber, Manuel
    Triebel, Rudolph
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 10749 - 10756
  • [9] Survey on 6D Pose Estimation of Rigid Object
    Chen, Jiale
    Zhang, Lijun
    Liu, Yi
    Xu, Chi
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7440 - 7445
  • [10] 6D Object Pose Estimation using Few-Shot Instance Segmentation and 3D Matching
    Li, Wanyi
    Sun, Jia
    Luo, Yongkang
    Wang, Peng
    [J]. 2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1071 - 1077