Pixel-Reasoning-Based Robotics Fine Grasping for Novel Objects with Deep EDINet Structure

被引:9
|
作者
Shi, Chaoquan [1 ]
Miao, Chunxiao [1 ]
Zhong, Xungao [1 ]
Zhong, Xunyu [2 ]
Hu, Huosheng [3 ]
Liu, Qiang [4 ]
机构
[1] Xiamen Univ Technol, Sch Elect Enginnering & Automat, Xiamen 361024, Peoples R China
[2] Xiamen Univ, Sch Aerosp Engn, Xiamen 361005, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[4] Univ Oxford, Dept Psychiat, Oxford OX1 2JD, England
基金
中国国家自然科学基金;
关键词
pixel-level reasoning; robotics fine grasping; EDINet deep network;
D O I
10.3390/s22114283
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Robotics grasp detection has mostly used the extraction of candidate grasping rectangles; those discrete sampling methods are time-consuming and may ignore the potential best grasp synthesis. This paper proposes a new pixel-level grasping detection method on RGB-D images. Firstly, a fine grasping representation is introduced to generate the gripper configurations of parallel-jaw, which can effectively resolve the gripper approaching conflicts and improve the applicability to unknown objects in cluttered scenarios. Besides, the adaptive grasping width is used to adaptively represent the grasping attribute, which is fine for objects. Then, the encoder-decoder-inception convolution neural network (EDINet) is proposed to predict the fine grasping configuration. In our findings, EDINet uses encoder, decoder, and inception modules to improve the speed and robustness of pixel-level grasping detection. The proposed EDINet structure was evaluated on the Cornell and Jacquard dataset; our method achieves 98.9% and 96.1% test accuracy, respectively. Finally, we carried out the grasping experiment on the unknown objects, and the results show that the average success rate of our network model is 97.2% in a single object scene and 93.7% in a cluttered scene, which out-performs the state-of-the-art algorithms. In addition, EDINet completes a grasp detection pipeline within only 25 ms.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] A novel fine-grained assembly sequence planning method based on knowledge graph and deep reinforcement learning
    Jiang, Mingjie
    Guo, Yu
    Huang, Shaohua
    Pu, Jun
    Zhang, Litong
    Wang, Shengbo
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 76 : 371 - 384
  • [42] A Novel Deep-Q-Network-Based Fine-Tuning Approach for Planar Bandpass Filter Design
    Ohira, Masataka
    Takano, Kohei
    Ma, Zhewang
    IEEE MICROWAVE AND WIRELESS COMPONENTS LETTERS, 2021, 31 (06) : 638 - 641
  • [43] A Novel Deep Learning-Based Relabeling Architecture for Space Objects Detection from Partially Annotated Astronomical Images
    Dumitrescu, Florin
    Ceachi, Bogdan
    Truica, Ciprian-Octavian
    Trascau, Mihai
    Florea, Adina Magda
    AEROSPACE, 2022, 9 (09)
  • [44] Discovery of Novel Gain-of-Function Mutations Guided by Structure-Based Deep Learning
    Shroff, Raghav
    Cole, Austin W.
    Diaz, Daniel J.
    Morrow, Barrett R.
    Donnell, Isaac
    Annapareddy, Ankur
    Gollihar, Jimmy
    Ellington, Andrew D.
    Thyer, Ross
    ACS SYNTHETIC BIOLOGY, 2020, 9 (11): : 2927 - 2935
  • [45] A novel lncRNA–protein interaction prediction method based on deep forest with cascade forest structure
    Xiongfei Tian
    Ling Shen
    Zhenwu Wang
    Liqian Zhou
    Lihong Peng
    Scientific Reports, 11
  • [46] SpectraTr: A novel deep learning model for qualitative analysis of drug spectroscopy based on transformer structure
    Fu, Pengyou
    Wen, Yue
    Zhang, Yuke
    Li, Lingqiao
    Feng, Yanchun
    Yin, Lihui
    Yang, Huihua
    JOURNAL OF INNOVATIVE OPTICAL HEALTH SCIENCES, 2022, 15 (03)
  • [47] Red-light running traffic violations: A novel time-based method for determining a fine structure
    Baratian-Ghorghi, Fatemeh
    Zhou, Huaguo
    Zech, Wesley C.
    TRANSPORTATION RESEARCH PART A-POLICY AND PRACTICE, 2016, 93 : 55 - 65
  • [48] Novel Surface Integral Equation-Based Sub-Structure Characteristic Mode Formulations for Lossy Composite Objects
    Ren, Hongwei
    Chen, Juan
    Feng, Penghao
    Wang, Buyun
    Vandenbosch, Guy A. E.
    Yan, Sen
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2024, 72 (11) : 8893 - 8898
  • [49] Measurement results of a 12 μm pixel size microbolometer array based on a novel thermally isolating structure using a 17 μm ROIC
    Muckensturm, K-M.
    Weiler, D.
    Hochschulz, F.
    Busch, C.
    Geruschke, T.
    Wall, S.
    Hess, J.
    Wuerfel, D.
    Lerch, R.
    Vogt, H.
    INFRARED TECHNOLOGY AND APPLICATIONS XLII, 2016, 9819
  • [50] A Novel Coarse-to-Fine Method of Ship Detection in Optical Remote Sensing Images Based on a Deep Residual Dense Network
    Chen, Liqiong
    Shi, Wenxuan
    Fan, Cien
    Zou, Lian
    Deng, Dexiang
    REMOTE SENSING, 2020, 12 (19)