Robotic Grasping With Multi-View Image Acquisition and Model-Based Pose Estimation

被引:26
|
作者
Lin, Huei-Yung [1 ,2 ]
Liang, Shih-Cheng [1 ]
Chen, Yu-Kai [1 ]
机构
[1] Natl Chung Cheng Univ, Dept Elect Engn, Chiayi 621301, Taiwan
[2] Natl Chung Cheng Univ, Adv Inst Mfg High Tech Innovat, Chiayi 621301, Taiwan
关键词
Three-dimensional displays; Pose estimation; Robots; Grasping; Cameras; Solid modeling; Computational modeling; 3D pose estimation; robotic grasping; visual servoing;
D O I
10.1109/JSEN.2020.3030791
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to recent advances on hardware and software technologies, industrial automation has been significantly improved in the past few decades. For random bin picking applications, it is a future trend to use machine vision based approaches to estimate the 3D poses of workpieces. In this work, we present a robotic grasping system with multi-view depth image acquisition. First, RANSAC and an outlier filter are adopted for noise removal and multi-object segmentation. A voting scheme is then used for preliminary pose computation, followed by the ICP algorithm to derive a more precise target orientation. A model-based registration approach using a genetic algorithm with parameter minimization is proposed for 6-DOF pose estimation. Finally, the grasping efficiency is increased by disturbance detection, which reduces the number of 3D data scanning for multiple operations. The experiments are carried out in the real scene environment, and the performance evaluation has demonstrated the feasibility of the proposed technique.
引用
收藏
页码:11870 / 11878
页数:9
相关论文
共 50 条
  • [1] Object Pose Estimation for Robotic Grasping based on Multi-view Keypoint Detection
    Hu, Zheyuan
    Hou, Renluan
    Niu, Jianwei
    Yu, Xiaolong
    Ren, Tao
    Li, Qingfeng
    19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 1295 - 1302
  • [2] Single-Camera Multi-View 6DoF pose estimation for robotic grasping
    Yuan, Shuangjie
    Ge, Zhenpeng
    Yang, Lu
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [3] Random Bin Picking with Multi-View Image Acquisition and CAD-Based Pose Estimation
    Chen, Kai
    Sun, Guo-Jhen
    Lin, Huei-Yung
    Chen, Shyh-Leh
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 2218 - 2223
  • [4] Multi-View Camera Pose Estimation for Robotic Arm Manipulation
    Ali, Ihtisham
    Suominen, Olli J.
    Morales, Emilio Ruiz
    Gotchev, Atanas
    IEEE ACCESS, 2020, 8 (08): : 174305 - 174316
  • [5] GhostPose: Multi-view Pose Estimation of Transparent Objects for Robot Hand Grasping
    Chang, Jaesik
    Kim, Minju
    Kang, Seongmin
    Han, Heungwoo
    Hong, Sunpyo
    Jang, Kyunghun
    Kang, Sungchul
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5749 - 5755
  • [6] IMAGE ACQUISITION AND MODEL SELECTION FOR MULTI-VIEW STEREO
    Wenzel, K.
    Rothermel, M.
    Fritsch, D.
    Haala, N.
    3D-ARCH 2013 - 3D VIRTUAL RECONSTRUCTION AND VISUALIZATION OF COMPLEX ARCHITECTURES, 2013, 40-5-W1 : 251 - 258
  • [7] Model-based image segmentation for multi-view human gesture analysis
    Wu, Chen
    Aghajan, Hamid
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PROCEEDINGS, 2007, 4678 : 310 - 321
  • [8] Multi-view segmentation based on human pose estimation in images
    Liu, Meng
    Qingxuan, Jia
    International Journal of Applied Mathematics and Statistics, 2013, 44 (14): : 104 - 111
  • [9] RobotFusion: Grasping with a Robotic Manipulator via Multi-view Reconstruction
    De Gregorio, Daniele
    Tombari, Federico
    Di Stefano, Luigi
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 634 - 647
  • [10] Multi-view Deep Learning for Image-based Pose Recovery
    Hong, Chaoqun
    Yu, Jun
    Xie, Yong
    Chen, Xuhui
    2015 IEEE 16TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2015, : 897 - 902