A Fast 6DOF Visual Selective Grasping System Using Point Clouds

被引:0
|
作者
de Oliveira, Daniel Moura [1 ]
Conceicao, Andre Gustavo Scolari [2 ]
机构
[1] Univ Fed Bahia, Postgrad Program Elect Engn, BR-40210630 Salvador, Brazil
[2] Univ Fed Bahia, Dept Elect & Comp Engn, LaR Robot Lab, BR-40210630 Salvador, Brazil
关键词
robot manipulation; grasping system; AI in robotics; deep learning; point clouds;
D O I
10.3390/machines11050540
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual object grasping can be complex when dealing with different shapes, points of view, and environments since the robotic manipulator must estimate the most feasible place to grasp. This work proposes a new selective grasping system using only point clouds of objects. For the selection of the object of interest, a deep learning network for object classification is proposed, named Point Encoder Convolution (PEC). The network is trained with a dataset obtained in a realistic simulator and uses an autoencoder with 1D convolution. The developed grasping algorithm used in the system uses geometry primitives and lateral curvatures to estimate the best region to grasp without previously knowing the object's point cloud. Experimental results show a success ratio of 94% for a dataset with five classes, and the proposed visual selective grasping system can be executed in around 0.004 s, suitable for tasks that require a low execution time or use low-cost hardware.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Digital Twin System for 6DoF Robot Grasping
    Chen, Zixuan
    Yuan, Xianzhe
    Cu, Qiang
    Hu, Chunxu
    He, Dingxin
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3292 - 3296
  • [2] 6DOF Object Positioning and Grasping Approach for Industrial Robots Based on Boundary Point Cloud Features
    Wan, Guoyang
    Wang, Guofeng
    Xing, Kaisheng
    Yi, Tinghao
    Fan, Yunsheng
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [3] Computer Vision Based Object Grasping 6DoF Robotic Arm Using Picamera
    Kumar, Vishal
    Wang, Qiang
    Wang Minghua
    Rizwan, Syed
    Shaikh, S. M.
    Liu, Xuan
    CONFERENCE PROCEEDINGS OF 2018 4TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2018, : 111 - 115
  • [4] 6DOF whole-hand haptic interaction system based on hybrid grasping approach
    Kim, Yongwan
    Jang, Yongseok
    Son, Wookho
    Park, Jinah
    HAPTICS: PERCEPTION, DEVICES AND SCENARIOS, PROCEEDINGS, 2008, 5024 : 549 - +
  • [5] Particle Filtering for Industrial 6DOF Visual Servoing
    Ibarguren, Aitor
    Maria Martinez-Otzeta, Jose
    Maurtua, Inaki
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2014, 74 (3-4) : 689 - 696
  • [6] 6DOF decoupled roto-translation alignment of large-scale indoor point clouds
    Al-Nuaimi, Anas
    Hilsenbeck, Sebastian
    Garcea, Adrian
    Steinbach, Eckehard
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 157 : 72 - 89
  • [7] Particle Filtering for Industrial 6DOF Visual Servoing
    Aitor Ibarguren
    José María Martínez-Otzeta
    Iñaki Maurtua
    Journal of Intelligent & Robotic Systems, 2014, 74 : 689 - 696
  • [8] A research on 6DOF measuring system and calilbration
    Jinyü, Z
    Bernhardt, R
    Surdilovic, D
    Proceedings of the Second IASTED International Conference on Biomedical Engineering, 2004, : 598 - 602
  • [9] Subjective Quality Database and Objective Study of Compressed Point Clouds With 6DoF Head-Mounted Display
    Wu, Xinju
    Zhang, Yun
    Fan, Chunling
    Hou, Junhui
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) : 4630 - 4644
  • [10] Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions
    Sattler, Torsten
    Maddern, Will
    Toft, Carl
    Torii, Akihiko
    Hammarstrand, Lars
    Stenborg, Erik
    Safari, Daniel
    Okutomi, Masatoshi
    Pollefeys, Marc
    Sivic, Josef
    Kahl, Fredrik
    Pajdla, Tomas
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8601 - 8610