Pixel-Reasoning-Based Robotics Fine Grasping for Novel Objects with Deep EDINet Structure

被引:9
|
作者
Shi, Chaoquan [1 ]
Miao, Chunxiao [1 ]
Zhong, Xungao [1 ]
Zhong, Xunyu [2 ]
Hu, Huosheng [3 ]
Liu, Qiang [4 ]
机构
[1] Xiamen Univ Technol, Sch Elect Enginnering & Automat, Xiamen 361024, Peoples R China
[2] Xiamen Univ, Sch Aerosp Engn, Xiamen 361005, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[4] Univ Oxford, Dept Psychiat, Oxford OX1 2JD, England
基金
中国国家自然科学基金;
关键词
pixel-level reasoning; robotics fine grasping; EDINet deep network;
D O I
10.3390/s22114283
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Robotics grasp detection has mostly used the extraction of candidate grasping rectangles; those discrete sampling methods are time-consuming and may ignore the potential best grasp synthesis. This paper proposes a new pixel-level grasping detection method on RGB-D images. Firstly, a fine grasping representation is introduced to generate the gripper configurations of parallel-jaw, which can effectively resolve the gripper approaching conflicts and improve the applicability to unknown objects in cluttered scenarios. Besides, the adaptive grasping width is used to adaptively represent the grasping attribute, which is fine for objects. Then, the encoder-decoder-inception convolution neural network (EDINet) is proposed to predict the fine grasping configuration. In our findings, EDINet uses encoder, decoder, and inception modules to improve the speed and robustness of pixel-level grasping detection. The proposed EDINet structure was evaluated on the Cornell and Jacquard dataset; our method achieves 98.9% and 96.1% test accuracy, respectively. Finally, we carried out the grasping experiment on the unknown objects, and the results show that the average success rate of our network model is 97.2% in a single object scene and 93.7% in a cluttered scene, which out-performs the state-of-the-art algorithms. In addition, EDINet completes a grasp detection pipeline within only 25 ms.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Fine-grained spectrum map inference: A novel approach based on deep residual network
    He, Shoushuai
    Zhu, Lei
    Wang, Lei
    Zeng, Weijun
    Qin, Zhen
    IET COMMUNICATIONS, 2024, 18 (16) : 925 - 937
  • [32] Research on fine lithospheric structure of Yishu fault zone based on deep reflection seismic profile
    Zhang S.
    Luo W.
    Yu X.
    Tian J.
    Tang L.
    Chen J.
    Yang B.
    Du S.
    Liu F.
    Wu K.
    Dizhi Xuebao/Acta Geologica Sinica, 2021, 95 (11): : 3192 - 3204
  • [33] A Deep CNN-Based Detection Method for Multi-Scale Fine-Grained Objects in Remote Sensing Images
    Xie, Qiyang
    Zhou, Daiying
    Tang, Rui
    Feng, Hao
    IEEE ACCESS, 2024, 12 : 15622 - 15630
  • [34] A novel temporal fine structure-based speech synthesis model for cochlear implant
    Chen, Fei
    Zhang, Yuan-Ting
    SIGNAL PROCESSING, 2008, 88 (11) : 2693 - 2699
  • [35] A novel W13 deep CNN structure for improved semantic segmentation of multiple objects in remote sensing imagery
    Khaled Mohammed Elgamily
    M. A. Mohamed
    Ahmed Mohamed Abou-Taleb
    Mohamed Maher Ata
    Neural Computing and Applications, 2025, 37 (7) : 5397 - 5427
  • [36] Improved facial emotion recognition model based on a novel deep convolutional structure
    Elsheikh, Reham A.
    Mohamed, M. A.
    Abou-Taleb, Ahmed Mohamed
    Ata, Mohamed Maher
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [37] A Novel Visual Measurement Method for Three-Dimensional Trajectory of Underwater Moving Objects Based on Deep Learning
    Liu, Tao
    Wang, Ningning
    Zhang, Lei
    Ai, Shangmao
    Du, Hongwang
    IEEE ACCESS, 2020, 8 : 186376 - 186392
  • [38] Solving floating pollution with deep learning: A novel SSD for floating objects based on continual unsupervised domain adaptation
    Chen, Renfei
    Wu, Jian
    Peng, Yong
    Li, Zhongwen
    Shang, Hua
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [39] AN ATLAS-BASED DEEP BRAIN STRUCTURE SEGMENTATION METHOD: FROM COARSE POSITIONING TO FINE SHAPING
    Luo, Yishan
    Chung, Albert C. S.
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 1085 - 1088
  • [40] A novel rhodamine-based Hg2+ sensor with a simple structure and fine performance
    Hong, Miaomiao
    Chen, Yufen
    Zhang, Yuping
    Xu, Dongmei
    ANALYST, 2019, 144 (24) : 7351 - 7358