Towards Deep Learning-based 6D Bin Pose Estimation in 3D Scans

被引:1
|
作者
Gajdosech, Lukas [1 ,2 ]
Kocur, Viktor [2 ,4 ]
Stuchlik, Martin [1 ]
Hudec, Lukas [3 ]
Madaras, Martin [1 ,2 ]
机构
[1] Skeletex Res, Karlova Ves, Slovakia
[2] Comenius Univ, Fac Math Phys & Informat, Bratislava, Slovakia
[3] Slovak Tech Univ Bratislava, Fac Informat & Informat Technol, Bratislava, Slovakia
[4] Brno Univ Technol, Fac Informat Technol, Brno, Czech Republic
关键词
Computer Vision; Bin Pose Estimation; 6D Pose Estimation; Deep Learning; Point Clouds;
D O I
10.5220/0010878200003124
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An automated robotic system needs to be as robust as possible and fail-safe in general while having relatively high precision and repeatability. Although deep learning-based methods are becoming research standard on how to approach 3D scan and image processing tasks, the industry standard for processing this data is still analytically-based. Our paper claims that analytical methods are less robust and harder for testing, updating, and maintaining. This paper focuses on a specific task of 6D pose estimation of a bin in 3D scans. Therefore, we present a high-quality dataset composed of synthetic data and real scans captured by a structured-light scanner with precise annotations. Additionally, we propose two different methods for 6D bin pose estimation, an analytical method as the industrial standard and a baseline data-driven method. Both approaches are cross-evaluated, and our experiments show that augmenting the training on real scans with synthetic data improves our proposed data-driven neural model. This position paper is preliminary, as proposed methods are trained and evaluated on a relatively small initial dataset which we plan to extend in the future.
引用
收藏
页码:545 / 552
页数:8
相关论文
共 50 条
  • [1] A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning
    Hoque, Sabera
    Arafat, Md. Yasir
    Xu, Shuxiang
    Maiti, Ananda
    Wei, Yuchen
    [J]. IEEE ACCESS, 2021, 9 : 143746 - 143770
  • [2] Validation of deep learning-based markerless 3D pose estimation
    Kosourikhina, Veronika
    Kavanagh, Diarmuid
    Richardson, Michael J.
    Kaplan, David M.
    [J]. PLOS ONE, 2022, 17 (10):
  • [3] Towards Learning 3d Object Detection and 6d Pose Estimation from Synthetic Data
    Rudorfer, Martin
    Neumann, Lukas
    Krueger, Joerg
    [J]. 2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1540 - 1543
  • [4] Deep Learning of Local RGB-D Patches for 3D Object Detection and 6D Pose Estimation
    Kehl, Wadim
    Milletari, Fausto
    Tombari, Federico
    Ilic, Slobodan
    Navab, Nassir
    [J]. COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 205 - 220
  • [5] Learning 6D Object Pose Estimation Using 3D Object Coordinates
    Brachmann, Eric
    Krull, Alexander
    Michel, Frank
    Gumhold, Stefan
    Shotton, Jamie
    Rother, Carsten
    [J]. COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 : 536 - 551
  • [6] Joint Optimization of the 3D Model and 6D Pose for Monocular Pose Estimation
    Guo, Liangchao
    Chen, Lin
    Wang, Qiufu
    Zhang, Zhuo
    Sun, Xiaoliang
    [J]. Drones, 2024, 8 (11)
  • [7] 6D pose estimation with combined deep learning and 3D vision techniques for a fast and accurate object grasping
    Le, Tuan-Tang
    Le, Trung-Son
    Chen, Yu-Ru
    Vidal, Joel
    Lin, Chyi-Yeu
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 141
  • [8] A Comprehensive Study on Deep Learning-Based 3D Hand Pose Estimation Methods
    Chatzis, Theocharis
    Stergioulas, Andreas
    Konstantinidis, Dimitrios
    Dimitropoulos, Kosmas
    Daras, Petros
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (19): : 1 - 27
  • [9] Deep learning-based real-time 3D human pose estimation
    Zhang, Xiaoyan
    Zhou, Zhengchun
    Han, Ying
    Meng, Hua
    Yang, Meng
    Rajasegarar, Sutharshan
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [10] Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation
    Hagelskjaer, Frederik
    Kruger, Norbert
    Buch, Anders
    [J]. PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 135 - 142