Pixel-Reasoning-Based Robotics Fine Grasping for Novel Objects with Deep EDINet Structure

被引:9
|
作者
Shi, Chaoquan [1 ]
Miao, Chunxiao [1 ]
Zhong, Xungao [1 ]
Zhong, Xunyu [2 ]
Hu, Huosheng [3 ]
Liu, Qiang [4 ]
机构
[1] Xiamen Univ Technol, Sch Elect Enginnering & Automat, Xiamen 361024, Peoples R China
[2] Xiamen Univ, Sch Aerosp Engn, Xiamen 361005, Peoples R China
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[4] Univ Oxford, Dept Psychiat, Oxford OX1 2JD, England
基金
中国国家自然科学基金;
关键词
pixel-level reasoning; robotics fine grasping; EDINet deep network;
D O I
10.3390/s22114283
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Robotics grasp detection has mostly used the extraction of candidate grasping rectangles; those discrete sampling methods are time-consuming and may ignore the potential best grasp synthesis. This paper proposes a new pixel-level grasping detection method on RGB-D images. Firstly, a fine grasping representation is introduced to generate the gripper configurations of parallel-jaw, which can effectively resolve the gripper approaching conflicts and improve the applicability to unknown objects in cluttered scenarios. Besides, the adaptive grasping width is used to adaptively represent the grasping attribute, which is fine for objects. Then, the encoder-decoder-inception convolution neural network (EDINet) is proposed to predict the fine grasping configuration. In our findings, EDINet uses encoder, decoder, and inception modules to improve the speed and robustness of pixel-level grasping detection. The proposed EDINet structure was evaluated on the Cornell and Jacquard dataset; our method achieves 98.9% and 96.1% test accuracy, respectively. Finally, we carried out the grasping experiment on the unknown objects, and the results show that the average success rate of our network model is 97.2% in a single object scene and 93.7% in a cluttered scene, which out-performs the state-of-the-art algorithms. In addition, EDINet completes a grasp detection pipeline within only 25 ms.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Deep Dexterous Grasping of Novel Objects From a Single View
    Aktas, Umit Rusen
    Zhao, Chao
    Kopicki, Marek
    Wyatt, Jeremy L.
    INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2022, 19 (02)
  • [2] Robotics Dexterous Grasping: The Methods Based on Point Cloud and Deep Learning
    Duan, Haonan
    Wang, Peng
    Huang, Yayu
    Xu, Guangyun
    Wei, Wei
    Shen, Xiaofei
    FRONTIERS IN NEUROROBOTICS, 2021, 15
  • [3] Deep Learning Method for Grasping Novel Objects Using Dexterous Hands
    Shang, Weiwei
    Song, Fangjing
    Zhao, Zengzhi
    Gao, Hongbo
    Cong, Shuang
    Li, Zhijun
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (05) : 2750 - 2762
  • [4] A novel robotic grasping method for moving objects based on multi-agent deep reinforcement learning
    Huang, Yu
    Liu, Daxin
    Liu, Zhenyu
    Wang, Ke
    Wang, Qide
    Tan, Jianrong
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2024, 86
  • [5] Robotic Grasping of Unknown Objects Based on Deep Learning-Based Feature Detection
    Khor, Kai Sherng
    Liu, Chao
    Cheah, Chien Chern
    SENSORS, 2024, 24 (15)
  • [6] A Vision-Based System for Grasping Novel Objects in Cluttered Environments
    Saxena, Ashutosh
    Wong, Lawson
    Quigley, Morgan
    Ng, Andrew Y.
    ROBOTICS RESEARCH, 2010, 66 : 337 - 348
  • [7] Application of Deep Learning in Mobile Robotics for Exploration and Recognition of Objects based on Images
    Contreras, Stevenson
    De la Rosa, Fernando
    2016 IEEE 11TH COLOMBIAN COMPUTING CONFERENCE (CCC), 2016,
  • [8] An Adaptive Control Based Approach for Gripping Novel Objects with Minimal Grasping Force
    Al-Mohammed, Mushtaq
    Ding, Z.
    Liu, P.
    Behal, A.
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2018, : 1040 - 1045
  • [9] A Graph-Based Deep Reinforcement Learning Approach to Grasping Fully Occluded Objects
    Guoyu Zuo
    Jiayuan Tong
    Zihao Wang
    Daoxiong Gong
    Cognitive Computation, 2023, 15 : 36 - 49
  • [10] Robotic Objects Detection and Grasping in Clutter Based on Cascaded Deep Convolutional Neural Network
    Liu, Dong
    Tao, Xiantong
    Yuan, Liheng
    Du, Yu
    Cong, Ming
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71