Deep Workpiece Region Segmentation for Bin Picking

被引:0
|
作者
Khalid, Muhammad Usman [1 ]
Hager, Janik M. [2 ]
Kraus, Werner [1 ]
Huber, Marco F. [3 ,4 ]
Toussaint, Marc [2 ]
机构
[1] Fraunhofer IPA, Robot & Assist Syst, Stuttgart, Germany
[2] Univ Stuttgart, Machine Learning & Robot Lab, Stuttgart, Germany
[3] Fraunhofer IPA, Ctr Cyber Cognit Intelligence CCD, Stuttgart, Germany
[4] Univ Stuttgart, Inst Ind Mfg & Management IFF, Stuttgart, Germany
来源
2019 IEEE 15TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE) | 2019年
基金
欧盟地平线“2020”;
关键词
D O I
10.1109/coase.2019.8843050
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For most industrial bin picking solutions, the pose of a workpiece is localized by matching a CAD model to point cloud obtained from 3D sensor. Distinguishing flat workpieces from bottom of the bin in point cloud imposes challenges in the localization of workpieces that lead to wrong or phantom detections. In this paper, we propose a framework that solves this problem by automatically segmenting workpiece regions from non-workpiece regions in a point cloud data. It is done in real time by applying a fully convolutional neural network trained on both simulated and real data. The real data has been labelled by our novel technique which automatically generates ground truth labels for real point clouds. Along with real time workpiece segmentation, our framework also helps in improving the number of detected workpieces and estimating the correct object poses. Moreover, it decreases the computation time by approximately 1s due to a reduction of the search space for the object pose estimation.
引用
收藏
页码:1138 / 1144
页数:7
相关论文
共 50 条
  • [1] Object Segmentation for Bin Picking Using Deep Learning
    Cordeiro, Artur
    Rocha, Luis F.
    Costa, Carlos
    Silva, Manuel F.
    ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 2, 2023, 590 : 53 - 66
  • [2] 3D Segmentation of Bin Picking by Domain Randomization
    Zhang, Zijiang
    Tsuchida, Shinya
    Lu, Humin
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2023, 2024, 1998 : 519 - 532
  • [3] Pose Estimation with Mismatching Region Detection in Robot Bin Picking
    Wang, Zhe
    Jia, Lei
    Zhang, Lei
    Zhuang, Chungang
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2017, PT II, 2017, 10463 : 36 - 47
  • [4] From belt picking to bin picking
    Balslev, I
    Eriksen, RD
    OPTOMECHATRONIC SYSTEMS III, 2002, 4902 : 616 - 623
  • [5] 3D Object Segmentation for Shelf Bin Picking by Humanoid with Deep Learning and Occupancy Voxel Grid Map
    Wada, Kentaro
    Murooka, Masaki
    Okada, Kei
    Inaba, Masayuki
    2016 IEEE-RAS 16TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS), 2016, : 1149 - 1154
  • [6] Towards Robust Part-aware Instance Segmentation for Industrial Bin Picking
    Feng, Yidan
    Yang, Biqi
    Li, Xianzhi
    Fu, Chi-Wing
    Cao, Rui
    Chen, Kai
    Dou, Qi
    Wei, Mingqiang
    Liu, Yun-Hui
    Heng, Pheng-Ann
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [7] Industrial bin picking: Cycle time and decoupling storage in industrial bin picking applications
    Sarna M.
    Weist J.
    Friedl F.
    Lüder A.
    ZWF Zeitschrift fuer Wirtschaftlichen Fabrikbetrieb, 2022, 117 (12): : 856 - 861
  • [8] A REALISTIC APPROACH TO BIN PICKING
    VANLAETHEM, D
    BOGAERT, M
    LEDOUX, O
    PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1985, 521 : 98 - 107
  • [9] RANGE IMAGE SEGMENTATION WITH APPLICATIONS TO ROBOT BIN-PICKING USING VACUUM GRIPPER
    ALHUJAZI, E
    SOOD, A
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1990, 20 (06): : 1313 - 1325
  • [10] Bin picking and flexible gripping
    Conneely, Karen
    ASSEMBLY AUTOMATION, 2009, 29 (01) : 5 - 7