Self-Supervised Antipodal Grasp Learning With Fine-Grained Grasp Quality Feedback in Clutter

被引:4
|
作者
Hou, Yanxu [1 ]
Li, Jun [1 ]
Chen, I-Ming [2 ]
机构
[1] Southeast Univ, Key Lab Measurement & Control CSE, Minist Educ, Nanjing 210096, Peoples R China
[2] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 639798, Singapore
关键词
Affordance map; antipodal degree; cluttered objects; deep reinforcement learning (DRL); robotic grasp;
D O I
10.1109/TIE.2023.3274854
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is a challenging goal in robotics to make a robot grasp like a human being in a cluttered environment. Self-supervised grasp learning (SGL) is one of the most promising approaches to human-like robotic grasp. However, due to inadequate feedback on grasp quality, almost existing SGL methods are coarse-grained. This article presents a fine-grained antipodal grasp learning (FAGL) method with augmented learning feedback. First, an indicator called antipodal degree of a grasp (ADG) is designed as a non-increasing monotonous function for the fine-grained evaluation of grasp quality according to the disturbance incurred by a grasp to the surroundings in the image space. Next, we design a restorative sampling strategy to collect antipodal grasp samples and propose a refined affordance network to generate grasp affordance maps for FAGL's decision of grasp policies. Finally, in grasping actual metal workpieces, FAGL outperforms its peers in grasp success rate and ADG in cluttered scenarios by reducing the grasp disturbance to the surroundings.
引用
收藏
页码:3853 / 3861
页数:9
相关论文
共 50 条
  • [1] Siamese self-supervised learning for fine-grained visual classification
    Ji, Ruyi
    Li, Jiaying
    Zhang, Libo
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 229
  • [2] Suction Grasp Region Prediction Using Self-supervised Learning for Object Picking in Dense Clutter
    Shaoa, Quanquan
    Hub, Jie
    Wang, Weiming
    Fang, Yi
    Liu, Wenhai
    Qi, Jin
    Ma, Jin
    [J]. 2019 IEEE 5TH INTERNATIONAL CONFERENCE ON MECHATRONICS SYSTEM AND ROBOTS (ICMSR 2019), 2019, : 7 - 12
  • [3] Fine-Grained Self-Supervised Learning with Jigsaw puzzles for medical image classification
    Department of Software, Ajou University, Korea, Republic of
    不详
    [J]. Comput. Biol. Med., 2024,
  • [4] Self-Supervised GlobalLocal Contrastive Learning for Fine-Grained Change Detection in VHR Images
    Jiang, Fenlong
    Gong, Maoguo
    Zheng, Hanhong
    Liu, Tongfei
    Zhang, Mingyang
    Liu, Jialu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [5] Coreset Sampling from Open-Set for Fine-Grained Self-Supervised Learning
    Kim, Sungnyun
    Bae, Sangmin
    Yun, Young
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7537 - 7547
  • [6] 6-DOF grasp planning of manipulator combined with self-supervised learning
    Ren, Zhenyu
    Peng, Gang
    Yang, Jin
    Wang, Hao
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 3026 - 3032
  • [7] Self-supervised learning of grasp dependent tool affordances on the iCub Humanoid robot
    Mar, Tanis
    Tikhanoff, Vadim
    Metta, Giorgio
    Natale, Lorenzo
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 3200 - 3206
  • [8] Convolutional Fine-Grained Classification With Self-Supervised Target Relation Regularization
    Liu, Kangjun
    Chen, Ke
    Jia, Kui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5570 - 5584
  • [9] Fine-Grained Object Classification via Self-Supervised Pose Alignment
    Yang, Xuhui
    Wang, Yaowei
    Chen, Ke
    Xu, Yong
    Tian, Yonghong
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7389 - 7398
  • [10] A Self-Supervised Tree-Structured Framework for Fine-Grained Classification
    Cai, Qihang
    Niu, Lei
    Shang, Xibin
    Ding, Heng
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (07):