Self-Supervised Antipodal Grasp Learning With Fine-Grained Grasp Quality Feedback in Clutter

被引:4
|
作者
Hou, Yanxu [1 ]
Li, Jun [1 ]
Chen, I-Ming [2 ]
机构
[1] Southeast Univ, Key Lab Measurement & Control CSE, Minist Educ, Nanjing 210096, Peoples R China
[2] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 639798, Singapore
关键词
Affordance map; antipodal degree; cluttered objects; deep reinforcement learning (DRL); robotic grasp;
D O I
10.1109/TIE.2023.3274854
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is a challenging goal in robotics to make a robot grasp like a human being in a cluttered environment. Self-supervised grasp learning (SGL) is one of the most promising approaches to human-like robotic grasp. However, due to inadequate feedback on grasp quality, almost existing SGL methods are coarse-grained. This article presents a fine-grained antipodal grasp learning (FAGL) method with augmented learning feedback. First, an indicator called antipodal degree of a grasp (ADG) is designed as a non-increasing monotonous function for the fine-grained evaluation of grasp quality according to the disturbance incurred by a grasp to the surroundings in the image space. Next, we design a restorative sampling strategy to collect antipodal grasp samples and propose a refined affordance network to generate grasp affordance maps for FAGL's decision of grasp policies. Finally, in grasping actual metal workpieces, FAGL outperforms its peers in grasp success rate and ADG in cluttered scenarios by reducing the grasp disturbance to the surroundings.
引用
收藏
页码:3853 / 3861
页数:9
相关论文
共 50 条
  • [31] Fine-Grained Adversarial Semi-Supervised Learning
    Mugnai, Daniele
    Pernici, Federico
    Turchini, Francesco
    Del Bimbo, Alberto
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (01)
  • [32] Fine-MVO: Toward Fine-Grained Feature Enhancement for Self-Supervised Monocular Visual Odometry in Dynamic Environments
    Wei, Wenhui
    Ping, Yang
    Li, Jiadong
    Liu, Xin
    Zhou, Yangfan
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 13947 - 13960
  • [33] Self-Supervised Fine-Grained Cycle-Separation Network (FSCN) for Visual-Audio Separation
    Ji, Yanli
    Ma, Shuo
    Xu, Xing
    Li, Xuelong
    Shen, Heng Tao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5864 - 5876
  • [34] Fine-Grained Segmentation Networks: Self-Supervised Segmentation for Improved Long-Term Visual Localization
    Larsson, Mans
    Stenborg, Erik
    Toft, Carl
    Hammarstrand, Lars
    Sattler, Torsten
    Kahl, Fredrik
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 31 - 41
  • [35] Effectiveness of Grasp Attributes and Motion-Constraints for Fine-Grained Recognition of Object Manipulation Actions
    Gupta, Kartik
    Burschka, Darius
    Bhaysar, Army
    [J]. PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 1232 - 1239
  • [36] Improving classification with semi-supervised and fine-grained learning
    Lai, Danyu
    Tian, Wei
    Chen, Long
    [J]. PATTERN RECOGNITION, 2019, 88 : 547 - 556
  • [37] Fine-grained visual classification with multi-scale features based on self-supervised attention filtering mechanism
    Chen, Haiyuan
    Cheng, Lianglun
    Huang, Guoheng
    Zhang, Ganghan
    Lan, Jiaying
    Yu, Zhiwen
    Pun, Chi-Man
    Ling, Wing-Kuen
    [J]. APPLIED INTELLIGENCE, 2022, 52 (13) : 15673 - 15689
  • [38] Fine-grained visual classification with multi-scale features based on self-supervised attention filtering mechanism
    Haiyuan Chen
    Lianglun Cheng
    Guoheng Huang
    Ganghan Zhang
    Jiaying Lan
    Zhiwen Yu
    Chi-Man Pun
    Wing-Kuen Ling
    [J]. Applied Intelligence, 2022, 52 : 15673 - 15689
  • [39] Co-Training Semi-Supervised Learning for Fine-Grained Air Quality Analysis
    Zhao, Yaning
    Wang, Li
    Zhang, Nannan
    Huang, Xiangwei
    Yang, Lunke
    Yang, Wenbiao
    [J]. ATMOSPHERE, 2023, 14 (01)
  • [40] Self-supervised Representation Learning for Fine Grained Human Hand Action Recognition in Industrial Assembly Lines
    Sturm, Fabian
    Sathiyababu, Rahul
    Allipilli, Harshitha
    Hergenroether, Elke
    Siegel, Melanie
    [J]. ADVANCES IN VISUAL COMPUTING, ISVC 2023, PT I, 2023, 14361 : 172 - 184