Effective grasp detection method based on Swin transformer

被引:0
|
作者
Zhang, Jing [1 ,2 ]
Tang, Yulin [2 ]
Luo, Yusong [2 ]
Du, Yukun [2 ]
Chen, Mingju [3 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Sichuan, Peoples R China
[3] Artificial Intelligence Key Lab Sichuan Prov, Yibin, Peoples R China
关键词
grasp detection; Swin transformer; attention mechanism; decoupled head; grasping tasks;
D O I
10.1117/1.JEI.33.3.033008
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. Grasp detection within unstructured environments encounters challenges that lead to a reduced success rate in grasping attempts, attributable to factors including object uncertainty, random positions, and differences in perspective. This work proposes a grasp detection algorithm framework, Swin-transNet, which adopts a hypothesis treating graspable objects as a generalized category and distinguishing between graspable and non-graspable objects. The utilization of the Swin transformer module in this framework augments the feature extraction process, enabling the capture of global relationships within images. Subsequently, the integration of a decoupled head with attention mechanisms further refines the channel and spatial representation of features. This strategic combination markedly improves the system's adaptability to uncertain object categories and random positions, culminating in the precise output of grasping information. Moreover, we elucidate their roles in grasping tasks. We evaluate the grasp detection framework using the Cornell grasp dataset, which is divided into image and object levels. The experiment indicated a detection accuracy of 98.1% and a detection speed of 52 ms. Swin-transNet shows robust generalization on the Jacquard dataset, attaining a detection accuracy of 95.2%. It demonstrates an 87.8% success rate in real-world grasping testing on a visual grasping system, confirming its effectiveness for robotic grasping tasks.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] Improved swin transformer-based defect detection method for transmission line patrol inspection images
    Dong, Kai
    Shen, Qingbin
    Wang, Chengyi
    Dong, Yanwu
    Liu, Qiuyue
    Lu, Ziqiang
    Lu, Ziying
    EVOLUTIONARY INTELLIGENCE, 2024, 17 (01) : 549 - 558
  • [22] Transmission Line Insulator Defect Detection Based on Swin Transformer and Context
    Yu Xi
    Ke Zhou
    Ling-Wen Meng
    Bo Chen
    Hao-Min Chen
    Jing-Yi Zhang
    Machine Intelligence Research, 2023, 20 : 729 - 740
  • [23] DETR Novel Small Target Detection Algorithm Based on Swin Transformer
    Xu, Fengchang
    Alfred, Rayner
    Pailus, Rayner Henry
    Lyu, Ge
    Du, Shifeng
    Chew, Jackel Vui Lung
    Li, Guozhang
    Wang, Xinliang
    IEEE ACCESS, 2024, 12 : 115838 - 115852
  • [24] Transmission Line Insulator Defect Detection Based on Swin Transformer and Context
    Xi, Yu
    Zhou, Ke
    Meng, Ling-Wen
    Chen, Bo
    Chen, Hao-Min
    Zhang, Jing-Yi
    MACHINE INTELLIGENCE RESEARCH, 2023, 20 (05) : 729 - 740
  • [25] Remote sensing object detection based on a combination of a CNN and the Swin transformer
    Yang, Liu
    Liang, Junhong
    Guo, Liang
    Long, Yang
    Ding, Kaiyan
    He, Qingfang
    Zhang, Zhihang
    REMOTE SENSING LETTERS, 2023, 14 (05) : 450 - 460
  • [26] Effective Light Field De-Occlusion Network Based on Swin Transformer
    Wang, Xingzheng
    Liu, Jiehao
    Chen, Songwei
    Wei, Guoyao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (06) : 2590 - 2599
  • [27] DST-FRD: A Distillation Method of Swin Transformer for Facial Reenactment Detection
    Wu, Haotian
    Chen, Yu
    Wang, Xin
    Wang, Lin
    Xiang, Ji
    Ren, Liyue
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2004 - 2009
  • [28] Research on Multiframe Lane Detection Method Using Swin Transformer Embedded with Attention
    Li, Yanhui
    Fang, Zhongchun
    Li, Hairong
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (04)
  • [29] Small Object Detection for Birds with Swin Transformer
    Huo, Da
    Kastner, Marc A.
    Liu, Tingwei
    Kawanishi, Yasutomo
    Hirayama, Takatsugu
    Komamizu, Takahiro
    Ide, Ichiro
    2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA, 2023,
  • [30] Down Syndrome detection with Swin Transformer architecture
    Wang, Chengyu
    Yu, Limin
    Su, Jionglong
    Mahy, Trevor
    Selis, Valerio
    Yang, Chunxiao
    Ma, Fei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86