Pixel-Reasoning-Based Robotics Fine Grasping for Novel Objects with Deep EDINet Structure

被引:9
|
作者
Shi, Chaoquan [1 ]
Miao, Chunxiao [1 ]
Zhong, Xungao [1 ]
Zhong, Xunyu [2 ]
Hu, Huosheng [3 ]
Liu, Qiang [4 ]
机构
[1] Xiamen Univ Technol, Sch Elect Enginnering & Automat, Xiamen 361024, Peoples R China
[2] Xiamen Univ, Sch Aerosp Engn, Xiamen 361005, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[4] Univ Oxford, Dept Psychiat, Oxford OX1 2JD, England
基金
中国国家自然科学基金;
关键词
pixel-level reasoning; robotics fine grasping; EDINet deep network;
D O I
10.3390/s22114283
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Robotics grasp detection has mostly used the extraction of candidate grasping rectangles; those discrete sampling methods are time-consuming and may ignore the potential best grasp synthesis. This paper proposes a new pixel-level grasping detection method on RGB-D images. Firstly, a fine grasping representation is introduced to generate the gripper configurations of parallel-jaw, which can effectively resolve the gripper approaching conflicts and improve the applicability to unknown objects in cluttered scenarios. Besides, the adaptive grasping width is used to adaptively represent the grasping attribute, which is fine for objects. Then, the encoder-decoder-inception convolution neural network (EDINet) is proposed to predict the fine grasping configuration. In our findings, EDINet uses encoder, decoder, and inception modules to improve the speed and robustness of pixel-level grasping detection. The proposed EDINet structure was evaluated on the Cornell and Jacquard dataset; our method achieves 98.9% and 96.1% test accuracy, respectively. Finally, we carried out the grasping experiment on the unknown objects, and the results show that the average success rate of our network model is 97.2% in a single object scene and 93.7% in a cluttered scene, which out-performs the state-of-the-art algorithms. In addition, EDINet completes a grasp detection pipeline within only 25 ms.
引用
收藏
页数:20
相关论文
共 50 条
  • [21] Memory Efficient Deep Learning-Based Grasping Point Detection of Nontrivial Objects for Robotic Bin Picking
    Dolezel, Petr
    Stursa, Dominik
    Kopecky, Dusan
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2024, 110 (03)
  • [22] Learning the Tactile Signatures of Prototypical Object Parts for Robust Part-based Grasping of Novel Objects
    Hyttinen, Emil
    Kragic, Danica
    Detry, Renaud
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 4927 - 4932
  • [23] Novel Pixel Structure with Stacked Deep Photodiode to Achieve High NIR Sensitivity and High MTF
    Takahashi, Hiroki
    Tanaka, Hiroshi
    Oda, Masahiro
    Ando, Mitsuyoshi
    Niisoe, Naoto
    Kawai, Shinichi
    Asano, Takuya
    Sudo, Minoru
    Yoshita, Mitsugu
    Yamada, Tohru
    2016 IEEE SYMPOSIUM ON VLSI TECHNOLOGY, 2016,
  • [24] A Novel Pyramidal CNN Deep Structure for Multiple Objects Detection in Remote Sensing Images
    Khaled Mohammed Elgamily
    M. A. Mohamed
    Ahmed Mohamed Abou-Taleb
    Mohamed Maher Ata
    Journal of the Indian Society of Remote Sensing, 2024, 52 (1) : 41 - 61
  • [25] A Novel Pyramidal CNN Deep Structure for Multiple Objects Detection in Remote Sensing Images
    Elgamily, Khaled Mohammed
    Mohamed, M. A.
    Abou-Taleb, Ahmed Mohamed
    Ata, Mohamed Maher
    JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2023, : 41 - 61
  • [26] Rotation adaptive grasping estimation network oriented to unknown objects based on novel RGB-D fusion strategy
    Tian, Hongkun
    Song, Kechen
    Li, Song
    Ma, Shuai
    Yan, Yunhui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [27] Image quality evaluation of LCDs based on novel RGBW sub-pixel structure
    Kim, Sungjin
    Kang, Dongwoo
    Lee, Jinsang
    Kim, Jaekyeom
    Park, Yongmin
    Han, Taeseong
    Jung, Sooyeon
    Yoo, Jong Jin
    Lim, Moojong
    Baek, Jongsang
    IMAGE QUALITY AND SYSTEM PERFORMANCE XII, 2015, 9396
  • [28] Uncooled microbolometer arrays with a pixel size of 12 μm based on a novel thermally isolating structure
    Muckensturm, Kai-Marcel
    Weiler, Dirk
    Hochschulz, Frank
    Busch, Claudia
    Geruschke, Thomas
    Wall, Simone
    Hess, Jennifer
    Lerch, Renee
    Wuerfel, Daniel
    Vogt, Holger
    TM-TECHNISCHES MESSEN, 2017, 84 (06) : 381 - 388
  • [29] A Novel Deep Learning-Based Pose Estimation Method for Robotic Grasping of Axisymmetric Bodies in Industrial Stacked Scenarios
    Li, Yaowei
    Guo, Fei
    Zhang, Miaotian
    Suo, Shuangfu
    An, Qi
    Li, Jinlin
    Wang, Yang
    MACHINES, 2022, 10 (12)
  • [30] One-step deep learning-based method for pixel-level detection of fine cracks in steel girder images
    Li, Zhihang
    Huang, Mengqi
    Ji, Pengxuan
    Zhu, Huamei
    Zhang, Qianbing
    SMART STRUCTURES AND SYSTEMS, 2022, 29 (01) : 153 - 166