SCOPS: Self-Supervised Co-Part Segmentation

被引:82
|
作者
Hung, Wei-Chih [1 ]
Jampani, Varun [2 ]
Liu, Sifei [2 ]
Molchanov, Pavlo [2 ]
Yang, Ming-Hsuan [1 ]
Kautz, Jan [2 ]
机构
[1] UC Merced, Merced, CA 95343 USA
[2] NVIDIA, Santa Clara, CA USA
关键词
D O I
10.1109/CVPR.2019.00096
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parts provide a good intermediate representation of objects that is robust with respect to the camera, pose and appearance variations. Existing works on part segmentation is dominated by supervised approaches that rely on large amounts of manual annotations and can not generalize to unseen object categories. We propose a self-supervised deep learning approach for part segmentation, where we devise several loss functions that aids in predicting part segments that are geometrically concentrated, robust to object variations and are also semantically consistent across different object instances. Extensive experiments on different types of image collections demonstrate that our approach can produce part segments that adhere to object boundaries and also more semantically consistent across object instances compared to existing self-supervised techniques.
引用
收藏
页码:869 / 878
页数:10
相关论文
共 50 条
  • [41] Self-Supervised Sequence Recovery for Semi-Supervised Retinal Layer Segmentation
    Yang, Jiadong
    Tao, Yuhui
    Xu, Qiuzhuo
    Zhang, Yuhan
    Ma, Xiao
    Yuan, Songtao
    Chen, Qiang
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (08) : 3872 - 3883
  • [42] Self-Supervised and Semi-Supervised Polyp Segmentation using Synthetic Data
    Moreu, Enric
    Arazo, Eric
    McGuinness, Kevin
    O'Connor, Noel E.
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [43] Self-supervised Correction Learning for Semi-supervised Biomedical Image Segmentation
    Zhang, Ruifei
    Liu, Sishuo
    Yu, Yizhou
    Li, Guanbin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 134 - 144
  • [44] Self-supervised Multi-scale Consistency for Weakly Supervised Segmentation Learning
    Valvano, Gabriele
    Leo, Andrea
    Tsaftaris, Sotirios A.
    DOMAIN ADAPTATION AND REPRESENTATION TRANSFER, AND AFFORDABLE HEALTHCARE AND AI FOR RESOURCE DIVERSE GLOBAL HEALTH (DART 2021), 2021, 12968 : 14 - 24
  • [45] SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentation
    Wang, Zhe
    Chen, Hao
    Li, Xinyu
    Liu, Chunhui
    Xiong, Yuanjun
    Tighe, Joseph
    Fowlkes, Charless
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 175 - 184
  • [46] Unsupervised Point Cloud Co-Part Segmentation via Co-Attended Superpoint Generation and Aggregation
    Umam, Ardian
    Yang, Cheng-Kun
    Chuang, Jen-Hui
    Lin, Yen-Yu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7775 - 7786
  • [47] Rethinking Self-Supervised Semantic Segmentation: Achieving End-to-End Segmentation
    Liu, Yue
    Zeng, Jun
    Tao, Xingzhen
    Fang, Gang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 10036 - 10046
  • [48] Self-supervised Diffusion Model for Anomaly Segmentation in Medical Imaging
    Kumar, Komal
    Chakraborty, Snehashis
    Roy, Sudipta
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2023, 2023, 14301 : 359 - 368
  • [49] Self-Supervised Surgical Tool Segmentation using Kinematic Information
    Rocha, Crisian da Costa
    Padoy, Nicolas
    Rosa, Benoit
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 8720 - 8726
  • [50] Mix-and-Match Tuning for Self-Supervised Semantic Segmentation
    Zhan, Xiaohang
    Liu, Ziwei
    Luo, Ping
    Tang, Xiaoou
    Loy, Chen Change
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7534 - 7541