Grasping Pose Estimation for Robots Based on Convolutional Neural Networks

被引:1
|
作者
Zheng, Tianjiao [1 ,2 ]
Wang, Chengzhi [1 ]
Wan, Yanduo [1 ]
Zhao, Sikai [1 ]
Zhao, Jie [1 ]
Shan, Debin [2 ]
Zhu, Yanhe [1 ]
机构
[1] Harbin Inst Technol, State Key Lab Robot & Syst, Harbin 150001, Peoples R China
[2] Harbin Inst Technol, Sch Mat Sci & Engn, Harbin 150001, Peoples R China
基金
国家重点研发计划; 中国博士后科学基金;
关键词
robot grasping; pose estimation; convolutional neural network; deep learning; MODEL;
D O I
10.3390/machines11100974
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Robots gradually have the ability to plan grasping actions in unknown scenes by learning the manipulation of typical scenes. The grasping pose estimation method, as a kind of end-to-end method, has rapidly developed in recent years because of its good generalization. In this paper, we present a grasping pose estimation method for robots based on convolutional neural networks. In this method, a convolutional neural network model was employed, which can output the grasping success rate, approach angle, and gripper opening width for the input voxel. The grasping dataset was produced, and the model was trained in the physical simulator. A position optimization of the robotic grasping was proposed according to the distribution of the object centroid to improve the grasping success rate. An experimental platform for robot grasping was established, and 11 common everyday objects were selected for the experiments. Grasping experiments involving the eleven objects individually, multiple objects, as well as a dark environment without illumination, were performed. The results show that the method has the adaptability to grasp different geometric objects, including irregular shapes, and it is not influenced by lighting conditions. The total grasping success rate was 88.2% for the individual objects and 81.1% for the cluttered scene.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Ensemble convolutional neural networks for pose estimation
    Kawana, Yuki
    Ukita, Norimichi
    Huang, Jia-Bin
    Yang, Ming-Hsuan
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 169 : 62 - 74
  • [2] Relative Pose Estimation of Visual SLAM Based on Convolutional Neural Networks
    Ruan, Xiaogang
    Wang, Fei
    Huang, Jing
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 8827 - 8832
  • [3] Human Pose Estimation Using Convolutional Neural Networks
    Singh, Anubhav
    Agarwal, Shruti
    Nagrath, Preeti
    Saxena, Anmol
    Thakur, Narina
    [J]. PROCEEDINGS 2019 AMITY INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (AICAI), 2019, : 946 - 952
  • [4] Driver pose estimation using convolutional neural networks
    Chen, Ren-Wen
    Yuan, Ting-Ting
    Huang, Wen-Bin
    Zhang, Yu-Xiang
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (04): : 813 - 821
  • [5] Benchmarking Convolutional Neural Networks for Object Segmentation and Pose Estimation
    Le, Tiffany
    Hamilton, Lei
    Torralba, Antonio
    [J]. 2017 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2017,
  • [6] Relative Camera Pose Estimation Using Convolutional Neural Networks
    Melekhov, Iaroslav
    Ylioinas, Juha
    Kannala, Juho
    Rahtu, Esa
    [J]. ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS (ACIVS 2017), 2017, 10617 : 675 - 687
  • [7] Benchmarking Convolutional Neural Networks for Object Segmentation and Pose Estimation
    Le, Tiffany
    Hamilton, Lei
    Torralba, Antonio
    [J]. 2017 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2017,
  • [8] The Aircraft Pose Estimation Based on a Convolutional Neural Network
    Fu, Daoyong
    Li, Wei
    Han, Songchen
    Zhang, Xinyan
    Zhan, Zhaohuan
    Yang, Menglong
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2019, 2019
  • [9] Object Detection and Pose Estimation based on Convolutional Neural Networks Trained with Synthetic Data
    Josifovski, Josip
    Kerzel, Matthias
    Pregizer, Christoph
    Posniak, Lukas
    Wermter, Stefan
    [J]. 2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 6269 - 6276
  • [10] On the use of Convolutional Neural Networks for Graphical Model-based Human Pose Estimation
    Huynh Vu
    Cheng, Eva
    Wilkinson, Richardt
    Lech, Margaret
    [J]. 2017 INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN SIGNAL PROCESSING, TELECOMMUNICATIONS & COMPUTING (SIGTELCOM), 2017, : 88 - 93