CGNet: Robotic Grasp Detection in Heavily Cluttered Scenes

被引:11
|
作者
Yu, Sheng [1 ]
Zhai, Di-Hua [1 ]
Xia, Yuanqing [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanism; grasp detection; grasp region; position focal loss; robot; MANIPULATION;
D O I
10.1109/TMECH.2022.3209488
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Robotic grasp technology has been widely used. However, the robotic grasp in cluttered scene is still a challenging problem. In this regard, this article proposes a novel robotic grasp detection method cluttered grasp network (CGNet). First, to make the network fully focus on important features, this article proposes a novel attention module two branches squeeze-and-excitation residual network (TSE-ResNet) and uses it as the backbone to extract features. Then, to detect grasp rectangle more accurately, a novel grasp region proposal module is proposed, which can well utilize the multiscale features and refine the grasp region. Finally, a novel position focal loss is proposed to detect the rotation angle of the grasp rectangle, and can well solve the problem of discontinuous rotation angle. The CGNet is trained and tested on the GraspNet-1Billion dataset and Cornell dataset, achieving 87.9 and 97.9% accuracy, respectively. Moreover, to test the effectiveness, the CGNet is also tested on the Multiobject dataset and Clutter dataset. The detection results show that the CGNet can well detect the grasp rectangle when faces unseen objects. The ablation experiments are also performed to verify the performance of proposed modules. The experimental results show that the proposed modules can improve the detection accuracy in the cluttered scene. Finally, to evaluate the generalization of the CGNet, it is also evaluated in the real world, and applied to the grasp task of a real Baxter robot, and obtained a grasping success rate of 91.7%.
引用
收藏
页码:884 / 894
页数:11
相关论文
共 50 条
  • [1] Grasp Region Exploration for 7-DoF Robotic Grasping in Cluttered Scenes
    Chen, Zibo
    Liu, Zhixuan
    Xie, Shangjin
    Zheng, Wei-Shi
    [J]. 2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 3169 - 3175
  • [2] A neural learning approach for simultaneous object detection and grasp detection in cluttered scenes
    Zhang, Yang
    Xie, Lihua
    Li, Yuheng
    Li, Yuan
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2023, 17
  • [3] Human factors of target detection tasks within heavily cluttered video scenes
    Huber, Samuel
    Wellig, Peter
    [J]. TARGET AND BACKGROUND SIGNATURES, 2015, 9653
  • [4] Context-Aware Grasp Generation in Cluttered Scenes
    Dinh-Cuong Hoang
    Stork, Johannes A.
    Stoyanov, Todor
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 1492 - 1498
  • [5] Multimodal Grasp Planner for Hybrid Grippers in Cluttered Scenes
    D'Avella, Salvatore
    Sundaram, Ashok M.
    Friedl, Werner
    Tripicchio, Paolo
    Roa, Maximo A.
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (04) : 2030 - 2037
  • [6] GPR: Grasp Pose Refinement Network for Cluttered Scenes
    Wei, Wei
    Luo, Yongkang
    Li, Fuyu
    Xu, Guangyun
    Zhong, Jun
    Li, Wanyi
    Wang, Peng
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 4295 - 4302
  • [7] Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes
    Chen, Siang
    Tang, Wei
    Xie, Pengwei
    Yang, Wenming
    Wang, Guijin
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (08) : 4895 - 4902
  • [8] ROI-based Robotic Grasp Detection for Object Overlapping Scenes
    Zhang, Hanbo
    Lan, Xuguang
    Bai, Site
    Zhou, Xinwen
    Tian, Zhiqiang
    Zheng, Nanning
    [J]. 2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : CP1 - CP34
  • [9] Digital Twin Robotic System With Continuous Learning for Grasp Detection in Variable Scenes
    Ren, Lei
    Dong, Jiabao
    Huang, Di
    Lu, Jinhu
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (07) : 7653 - 7663
  • [10] Detection of moving individuals in cluttered scenes
    Christogiannopoulos, G.
    Young, R. C.
    Chatwin, C. R.
    [J]. OPTICAL PATTERN RECOGNITON XVII, 2006, 6245