SCOPS: Self-Supervised Co-Part Segmentation

被引:82
|
作者
Hung, Wei-Chih [1 ]
Jampani, Varun [2 ]
Liu, Sifei [2 ]
Molchanov, Pavlo [2 ]
Yang, Ming-Hsuan [1 ]
Kautz, Jan [2 ]
机构
[1] UC Merced, Merced, CA 95343 USA
[2] NVIDIA, Santa Clara, CA USA
关键词
D O I
10.1109/CVPR.2019.00096
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Parts provide a good intermediate representation of objects that is robust with respect to the camera, pose and appearance variations. Existing works on part segmentation is dominated by supervised approaches that rely on large amounts of manual annotations and can not generalize to unseen object categories. We propose a self-supervised deep learning approach for part segmentation, where we devise several loss functions that aids in predicting part segments that are geometrically concentrated, robust to object variations and are also semantically consistent across different object instances. Extensive experiments on different types of image collections demonstrate that our approach can produce part segments that adhere to object boundaries and also more semantically consistent across object instances compared to existing self-supervised techniques.
引用
收藏
页码:869 / 878
页数:10
相关论文
共 50 条
  • [1] Motion-supervised Co-Part Segmentation
    Siarohin, Aliaksandr
    Roy, Subhankar
    Lathuiliere, Stephane
    Tulyakov, Sergey
    Ricci, Elisa
    Sebe, Nicu
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9650 - 9657
  • [2] Self-supervised part segmentation via motion imitation
    Zhang, Yanping
    Liang, Qiaokang
    Zou, Kunlin
    Li, Zhengwei
    Sun, Wei
    Wang, Yaonan
    IMAGE AND VISION COMPUTING, 2022, 120
  • [3] Unsupervised Co-part Segmentation through Assembly
    Gao, Qingzhe
    Wang, Bin
    Liu, Libin
    Chen, Baoquan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [4] SELF-SUPERVISED AUDIO-VISUAL CO-SEGMENTATION
    Rouditchenko, Andrew
    Zhao, Hang
    Gan, Chuang
    McDermott, Josh
    Torralba, Antonio
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 2357 - 2361
  • [5] Self-Supervised Instance Segmentation by Grasping
    Liu, YuXuan
    Chen, Xi
    Abbeel, Pieter
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 1162 - 1169
  • [6] Self-Supervised Segmentation of River Scenes
    Achar, Supreeth
    Sankaran, Bharath
    Nuske, Stephen
    Scherer, Sebastian
    Singh, Sanjiv
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [7] Self-Supervised Interactive Image Segmentation
    Shi, Qingxuan
    Li, Yihang
    Di, Huijun
    Wu, Enyi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 6797 - 6808
  • [8] Self-supervised vision transformers for semantic segmentation
    Gu, Xianfan
    Hu, Yingdong
    Wen, Chuan
    Gao, Yang
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2025, 251
  • [9] Online Self-Supervised Segmentation of Dynamic Objects
    Guizilini, Vitor
    Ramos, Fabio
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 4720 - 4727
  • [10] Sensei: Self-Supervised Sensor Name Segmentation
    Wu, Jiaman
    Hong, Dezhi
    Gupta, Rajesh K.
    Shang, Jingbo
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1017 - 1027