Effective grasp detection method based on Swin transformer

被引:0
|
作者
Zhang, Jing [1 ,2 ]
Tang, Yulin [2 ]
Luo, Yusong [2 ]
Du, Yukun [2 ]
Chen, Mingju [3 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Sichuan, Peoples R China
[3] Artificial Intelligence Key Lab Sichuan Prov, Yibin, Peoples R China
关键词
grasp detection; Swin transformer; attention mechanism; decoupled head; grasping tasks;
D O I
10.1117/1.JEI.33.3.033008
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. Grasp detection within unstructured environments encounters challenges that lead to a reduced success rate in grasping attempts, attributable to factors including object uncertainty, random positions, and differences in perspective. This work proposes a grasp detection algorithm framework, Swin-transNet, which adopts a hypothesis treating graspable objects as a generalized category and distinguishing between graspable and non-graspable objects. The utilization of the Swin transformer module in this framework augments the feature extraction process, enabling the capture of global relationships within images. Subsequently, the integration of a decoupled head with attention mechanisms further refines the channel and spatial representation of features. This strategic combination markedly improves the system's adaptability to uncertain object categories and random positions, culminating in the precise output of grasping information. Moreover, we elucidate their roles in grasping tasks. We evaluate the grasp detection framework using the Cornell grasp dataset, which is divided into image and object levels. The experiment indicated a detection accuracy of 98.1% and a detection speed of 52 ms. Swin-transNet shows robust generalization on the Jacquard dataset, attaining a detection accuracy of 95.2%. It demonstrates an 87.8% success rate in real-world grasping testing on a visual grasping system, confirming its effectiveness for robotic grasping tasks.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] A Novel Effective Vehicle Detection Method Based on Swin Transformer in Hazy Scenes
    Sun, Zaiming
    Liu, Chang'an
    Qu, Hongquan
    Xie, Guangda
    MATHEMATICS, 2022, 10 (13)
  • [2] Highly Discriminative Driver Distraction Detection Method Based on Swin Transformer
    Zhang, Ziyang
    Yang, Lie
    Lv, Chen
    VEHICLES, 2024, 6 (01): : 140 - 156
  • [3] Robotic Grasp Detection Based on Transformer
    Dong, Mingshuai
    Bai, Yuxuan
    Wei, Shimin
    Yu, Xiuli
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT IV, 2022, 13458 : 437 - 448
  • [4] ST-LaneNet: Lane Line Detection Method Based on Swin Transformer and LaneNet
    Du, Yufeng
    Zhang, Rongyun
    Shi, Peicheng
    Zhao, Linfeng
    Zhang, Bin
    Liu, Yaming
    CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2024, 37 (01)
  • [5] ST-LaneNet: Lane Line Detection Method Based on Swin Transformer and LaneNet
    Yufeng Du
    Rongyun Zhang
    Peicheng Shi
    Linfeng Zhao
    Bin Zhang
    Yaming Liu
    Chinese Journal of Mechanical Engineering, 2024, 37 (01) : 143 - 158
  • [6] ST-LaneNet: Lane Line Detection Method Based on Swin Transformer and LaneNet
    Yufeng Du
    Rongyun Zhang
    Peicheng Shi
    Linfeng Zhao
    Bin Zhang
    Yaming Liu
    Chinese Journal of Mechanical Engineering, 37
  • [7] EDSD: efficient driving scenes detection based on Swin Transformer
    Wei Chen
    Ruihan Zheng
    Jiade Jiang
    Zijian Tian
    Fan Zhang
    Yi Liu
    Multimedia Tools and Applications, 2024, 83 (39) : 87179 - 87198
  • [8] A Driving Area Detection Algorithm Based on Improved Swin Transformer
    Liu, Shuang
    Li, Ying
    Sheng, Huankun
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (02) : 227 - 234
  • [9] A Driving Area Detection Algorithm Based on Improved Swin Transformer
    Li, Ying
    Liu, Shuang
    Sheng, Huankun
    SSRN, 2023,
  • [10] Swin transformer based vehicle detection in undisciplined traffic environment
    Deshmukh, Prashant
    Satyanarayana, G. S. R.
    Majhi, Sudhan
    Sahoo, Upendra Kumar
    Das, Santos Kumar
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213