SCOPS: Self-Supervised Co-Part Segmentation

被引:82
|
作者
Hung, Wei-Chih [1 ]
Jampani, Varun [2 ]
Liu, Sifei [2 ]
Molchanov, Pavlo [2 ]
Yang, Ming-Hsuan [1 ]
Kautz, Jan [2 ]
机构
[1] UC Merced, Merced, CA 95343 USA
[2] NVIDIA, Santa Clara, CA USA
关键词
D O I
10.1109/CVPR.2019.00096
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parts provide a good intermediate representation of objects that is robust with respect to the camera, pose and appearance variations. Existing works on part segmentation is dominated by supervised approaches that rely on large amounts of manual annotations and can not generalize to unseen object categories. We propose a self-supervised deep learning approach for part segmentation, where we devise several loss functions that aids in predicting part segments that are geometrically concentrated, robust to object variations and are also semantically consistent across different object instances. Extensive experiments on different types of image collections demonstrate that our approach can produce part segments that adhere to object boundaries and also more semantically consistent across object instances compared to existing self-supervised techniques.
引用
收藏
页码:869 / 878
页数:10
相关论文
共 50 条
  • [21] Self-Supervised Deep TripleNet for Video Object Segmentation
    Xu, Kai
    Wen, Longyin
    Li, Guorong
    Huang, Qingming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3530 - 3539
  • [22] MoA-Net: Self-supervised Motion Segmentation
    Bideau, Pia
    Menon, Rakesh R.
    Learned-Miller, Erik
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 715 - 730
  • [23] Self-supervised temporal autoencoder for egocentric action segmentation
    Zhang, Mingming
    Liu, Dong
    Hu, Shizhe
    Yan, Xiaoqiang
    Sun, Zhongchuan
    Ye, Yangdong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [24] Multiview Self-Supervised Segmentation for OARs Delineation in Radiotherapy
    Liu, Cong
    Zhang, Xiaofei
    Si, Wen
    Ni, Xinye
    EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE, 2021, 2021
  • [25] Self-Supervised Vessel Segmentation via Adversarial Learning
    Ma, Yuxin
    Hua, Yang
    Deng, Hanming
    Song, Tao
    Wang, Hao
    Xue, Zhengui
    Cao, Heng
    Ma, Ruhui
    Guan, Haibing
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7516 - 7525
  • [26] Self-supervised Segmentation by Grouping Optical-Flow
    Mahendran, Aravindh
    Thewlis, James
    Vedaldi, Andrea
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 528 - 534
  • [27] PHONEME SEGMENTATION USING SELF-SUPERVISED SPEECH MODELS
    Strgar, Luke
    Harwath, David
    2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 1067 - 1073
  • [28] Self-supervised Augmentation Consistency for Adapting Semantic Segmentation
    Araslanov, Nikita
    Roth, Stefan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15379 - 15389
  • [29] Self-supervised contrastive representation learning for semantic segmentation
    Liu B.
    Cai H.
    Wang Y.
    Chen X.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2024, 51 (01): : 125 - 134
  • [30] Self-supervised Learning to Improve Froth Images Segmentation
    Rumiantceva, Mariia
    Kriukov, Andrei
    Prokopov, Egor
    Efimova, Valeria
    PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, VOL 10, ICICT 2024, 2025, 1055 : 483 - 494