Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

被引:1
|
作者
Zheng, Tianjiao [1 ,2 ]
Wang, Chengzhi [1 ]
Wan, Yanduo [1 ]
Zhao, Sikai [1 ]
Zhao, Jie [1 ]
Shan, Debin [2 ]
Zhu, Yanhe [1 ]
机构
[1] Harbin Inst Technol, State Key Lab Robot & Syst, Harbin 150001, Peoples R China
[2] Harbin Inst Technol, Sch Mat Sci & Engn, Harbin 150001, Peoples R China
基金
国家重点研发计划; 中国博士后科学基金;
关键词
robot grasping; pose estimation; convolutional neural network; deep learning; MODEL;
D O I
10.3390/machines11100974
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Robots gradually have the ability to plan grasping actions in unknown scenes by learning the manipulation of typical scenes. The grasping pose estimation method, as a kind of end-to-end method, has rapidly developed in recent years because of its good generalization. In this paper, we present a grasping pose estimation method for robots based on convolutional neural networks. In this method, a convolutional neural network model was employed, which can output the grasping success rate, approach angle, and gripper opening width for the input voxel. The grasping dataset was produced, and the model was trained in the physical simulator. A position optimization of the robotic grasping was proposed according to the distribution of the object centroid to improve the grasping success rate. An experimental platform for robot grasping was established, and 11 common everyday objects were selected for the experiments. Grasping experiments involving the eleven objects individually, multiple objects, as well as a dark environment without illumination, were performed. The results show that the method has the adaptability to grasp different geometric objects, including irregular shapes, and it is not influenced by lighting conditions. The total grasping success rate was 88.2% for the individual objects and 81.1% for the cluttered scene.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Graph Convolutional Neural Networks-based 3D Hand Pose Estimation over Point Clouds
    Alejandro Castro-Vargas, John
    Martinez-Gonzalez, Pablo
    Oprea, Sergiu
    Garcia-Garcia, Alberto
    Orts-Escolano, Sergio
    Garcia-Rodriguez, Jose
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [42] Human Pose Estimation and Gait Analysis with Convolutional Neural Networks for Alzheimer's Disease Detection
    Seifallahi, Mahmoud
    Farrell, Brennen
    Galvin, James E.
    Ghoraani, Behnaz
    [J]. BIG DATA VI: LEARNING, ANALYTICS, AND APPLICATIONS, 2024, 13036
  • [43] Grasping of Unknown Objects using Deep Convolutional Neural Networks based on Depth Images
    Schmidt, Philipp
    Vahrenkamp, Nikolaus
    Waechter, Mirko
    Asfour, Tamim
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 6831 - 6838
  • [44] Improving Vision Based Pose Estimation Using LSTM Neural Networks
    Bila, Diyar Khalis
    Unel, Mustafa
    Tunc, Lutfi Taner
    [J]. IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 483 - 488
  • [45] Convolutional Neural Networks Based Joint AOA/TOF Estimation
    Jang, Suhwan
    Lee, Hyunwook
    Lee, Chungyong
    [J]. 2021 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2021,
  • [46] Depth estimation for monocular image based on convolutional neural networks
    Niu, Binglin
    Tang, Mengxia
    Chen, Xuelin
    [J]. International Journal of Circuits, Systems and Signal Processing, 2021, 15 : 533 - 540
  • [47] Pose Estimation-Assisted Dance Tracking System Based on Convolutional Neural Network
    Mu, Jin
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [48] A lightweight convolutional neural network for pose estimation of a planar model
    Ocegueda-Hernandez, Vladimir
    Roman-Godinez, Israel
    Mendizabal-Ruiz, Gerardo
    [J]. MACHINE VISION AND APPLICATIONS, 2022, 33 (03)
  • [49] Deep convolutional neural network-based Bernoulli heatmap for head pose estimation
    Hu, Zhongxu
    Xing, Yang
    Lv, Chen
    Hang, Peng
    Liu, Jie
    [J]. NEUROCOMPUTING, 2021, 436 : 198 - 209
  • [50] A lightweight convolutional neural network for pose estimation of a planar model
    Vladimir Ocegueda-Hernández
    Israel Román-Godínez
    Gerardo Mendizabal-Ruiz
    [J]. Machine Vision and Applications, 2022, 33