SCOPS: Self-Supervised Co-Part Segmentation

被引:82
|
作者
Hung, Wei-Chih [1 ]
Jampani, Varun [2 ]
Liu, Sifei [2 ]
Molchanov, Pavlo [2 ]
Yang, Ming-Hsuan [1 ]
Kautz, Jan [2 ]
机构
[1] UC Merced, Merced, CA 95343 USA
[2] NVIDIA, Santa Clara, CA USA
关键词
D O I
10.1109/CVPR.2019.00096
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parts provide a good intermediate representation of objects that is robust with respect to the camera, pose and appearance variations. Existing works on part segmentation is dominated by supervised approaches that rely on large amounts of manual annotations and can not generalize to unseen object categories. We propose a self-supervised deep learning approach for part segmentation, where we devise several loss functions that aids in predicting part segments that are geometrically concentrated, robust to object variations and are also semantically consistent across different object instances. Extensive experiments on different types of image collections demonstrate that our approach can produce part segments that adhere to object boundaries and also more semantically consistent across object instances compared to existing self-supervised techniques.
引用
收藏
页码:869 / 878
页数:10
相关论文
共 50 条
  • [31] Self-Supervised Tuning for Few-Shot Segmentation
    Zhu, Kai
    Zhai, Wei
    Cao, Yang
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1019 - 1025
  • [32] Self-Supervised Contrastive Learning for Unsupervised Phoneme Segmentation
    Kreuk, Felix
    Keshet, Joseph
    Adi, Yossi
    INTERSPEECH 2020, 2020, : 3700 - 3704
  • [33] Self-supervised Pre-training for Nuclei Segmentation
    Haq, Mohammad Minhazul
    Huang, Junzhou
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 303 - 313
  • [34] Self-supervised Transparent Liquid Segmentation for Robotic Pouring
    Narasimhan, Gautham
    Zhang, Kai
    Eisner, Ben
    Lin, Xingyu
    Held, David
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 4555 - 4561
  • [35] Segmentation for regions of interest in radiotherapy by self-supervised learning
    Yu, Chengrong
    Hu, Junjie
    Li, Guiyuan
    Zhu, Shengqian
    Bai, Sen
    Yi, Zhang
    KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [36] Self-Supervised Learning of Object Parts for Semantic Segmentation
    Ziegler, Adrian
    Asano, Yuki M.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14482 - 14491
  • [37] Self-supervised Video Object Segmentation by Motion Grouping
    Yang, Charig
    Lamdouar, Hala
    Lu, Erika
    Zisserman, Andrew
    Xie, Weidi
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7157 - 7168
  • [38] Self-Supervised Model Adaptation for Multimodal Semantic Segmentation
    Abhinav Valada
    Rohit Mohan
    Wolfram Burgard
    International Journal of Computer Vision, 2020, 128 : 1239 - 1285
  • [39] Self-Supervised Pretraining Improves Self-Supervised Pretraining
    Reed, Colorado J.
    Yue, Xiangyu
    Nrusimha, Ani
    Ebrahimi, Sayna
    Vijaykumar, Vivek
    Mao, Richard
    Li, Bo
    Zhang, Shanghang
    Guillory, Devin
    Metzger, Sean
    Keutzer, Kurt
    Darrell, Trevor
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1050 - 1060
  • [40] S6: SEMI-SUPERVISED SELF-SUPERVISED SEMANTIC SEGMENTATION
    Soliman, Moamen
    Lehman, Charles
    AlRegib, Ghassan
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1861 - 1865