Attention-based efficient robot grasp detection network

被引:3
|
作者
Qin, Xiaofei [1 ]
Hu, Wenkai [1 ]
Xiao, Chen [2 ]
He, Changxiang [2 ]
Pei, Songwen [1 ,3 ,4 ]
Zhang, Xuedian [1 ,3 ,4 ,5 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[2] Univ Shanghai Sci & Technol, Coll Sci, Shanghai 200093, Peoples R China
[3] Shanghai Key Lab Modern Opt Syst, Shanghai 200093, Peoples R China
[4] Minist Educ, Key Lab Biomed Opt Technol & Devices, Shanghai 200093, Peoples R China
[5] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 201210, Peoples R China
关键词
Robot grasp detection; Attention mechanism; Encoder-decoder; Neural network;
D O I
10.1631/FITEE.2200502
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To balance the inference speed and detection accuracy of a grasp detection algorithm, which are both important for robot grasping tasks, we propose an encoder-decoder structured pixel-level grasp detection neural network named the attention-based efficient robot grasp detection network (AE-GDN). Three spatial attention modules are introduced in the encoder stages to enhance the detailed information, and three channel attention modules are introduced in the decoder stages to extract more semantic information. Several lightweight and efficient DenseBlocks are used to connect the encoder and decoder paths to improve the feature modeling capability of AE-GDN. A high intersection over union (IoU) value between the predicted grasp rectangle and the ground truth does not necessarily mean a high-quality grasp configuration, but might cause a collision. This is because traditional IoU loss calculation methods treat the center part of the predicted rectangle as having the same importance as the area around the grippers. We design a new IoU loss calculation method based on an hourglass box matching mechanism, which will create good correspondence between high IoUs and high-quality grasp configurations. AEGDN achieves the accuracy of 98.9% and 96.6% on the Cornell and Jacquard datasets, respectively. The inference speed reaches 43.5 frames per second with only about 1.2 x 10(6) parameters. The proposed AE-GDN has also been deployed on a practical robotic arm grasping system and performs grasping well.
引用
收藏
页码:1430 / 1444
页数:15
相关论文
共 50 条
  • [31] An Attention-Based GRU Network for Anomaly Detection from System Logs
    Xie, Yixi
    Ji, Lixin
    Cheng, Xiaotao
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (08) : 1916 - 1919
  • [32] Topical-Relevance Detection Using Attention-Based Neural Network
    Li, Xia
    Yang, Zhanyuan
    Chen, Minping
    Feng, Wenhe
    2018 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2018, : 373 - 377
  • [33] An attention-based progressive fusion network for pixelwise pavement crack detection
    Ma, Mingyang
    Yang, Lei
    Liu, Yanhong
    Yu, Hongnian
    MEASUREMENT, 2024, 226
  • [34] Attention-Based Bi-LSTM Network for Abusive Language Detection
    Nelatoori, Kiran Babu
    Kommanti, Hima Bindu
    IETE JOURNAL OF RESEARCH, 2023, 69 (11) : 7884 - 7892
  • [35] LABANet: A Lightweight Asymmetrical Bottleneck and Attention-Based Network for Cloud Detection
    Yu, Ximing
    Peng, Yu
    Shao, Wenyi
    Liu, Liansheng
    Sun, Kaipeng
    IEEE SENSORS JOURNAL, 2024, 24 (04) : 4771 - 4785
  • [36] Attention-based Neighbor Selective Aggregation Network for Camouflaged Object Detection
    Cheng, Yao
    Hao, Hao-Zhou
    Ji, Yi
    Li, Ying
    Liu, Chun-Ping
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [37] A Hierarchical Attention-Based Neural Network Model for Socialbot Detection in OSN
    Fazil, Mohd
    Sah, Amit Kumar
    Abulaish, Muhammad
    2020 IEEE/WIC/ACM INTERNATIONAL JOINT CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY (WI-IAT 2020), 2020, : 954 - 959
  • [38] DSNet: Double Strand Robotic Grasp Detection Network Based on Cross Attention
    Zhang, Yonghong
    Qin, Xiayang
    Dong, Tiantian
    Li, Yuchao
    Song, Hongcheng
    Liu, Yunping
    Li, Ziqi
    Liu, Qi
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (05): : 4702 - 4709
  • [39] A novel large-kernel residual grasp network for robot grasp detection
    Jiang, Yanshu
    Fang, Yanze
    Deng, Liwei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [40] Research on Robot Classifiable Grasp Detection Method Based on Convolutional Neural Network
    Yang, Lin
    Cui, Guohua
    Chen, Saixuan
    Zhu, Xinlong
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2021, PT III, 2021, 13015 : 705 - 715