Simple Does It: Weakly Supervised Instance and Semantic Segmentation

被引:483
|
作者
Khoreva, Anna [1 ]
Benenson, Rodrigo [1 ]
Hosang, Jan [1 ]
Hein, Matthias [2 ]
Schiele, Bernt [1 ]
机构
[1] Max Planck Inst Informat, Saarbrucken, Germany
[2] Saarland Univ, Saarbrucken, Germany
关键词
D O I
10.1109/CVPR.2017.181
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic labelling and instance segmentation are two tasks that require particularly costly annotations. Starting from weak supervision in the form of bounding box detection annotations, we propose a new approach that does not require modification of the segmentation training procedure. We show that when carefully designing the input labels from given bounding boxes, even a single round of training is enough to improve over previously reported weakly supervised results. Overall, our weak supervision approach reaches similar to 95% of the quality of the fully supervised model, both for semantic labelling and instance segmentation.
引用
下载
收藏
页码:1665 / 1674
页数:10
相关论文
共 50 条
  • [1] Beyond Semantic to Instance Segmentation: Weakly-Supervised Instance Segmentation via Semantic Knowledge Transfer and Self-Refinement
    Kim, Beomyoung
    Yoo, Youngjoon
    Rhee, Chae Eun
    Kim, Junmo
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4268 - 4277
  • [2] BBAM: Bounding Box Attribution Map for Weakly Supervised Semantic and Instance Segmentation
    Lee, Jungbeom
    Yi, Jihun
    Shin, Chaehun
    Yoon, Sungroh
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2643 - 2651
  • [3] DISCOBOX: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision
    Lan, Shiyi
    Yu, Zhiding
    Choy, Christopher
    Radhakrishnan, Subhashree
    Liu, Guilin
    Zhu, Yuke
    Davis, Larry S.
    Anandkumar, Anima
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3386 - 3396
  • [4] Towards Weakly Supervised Semantic Segmentation by Means of Multiple Instance and Multitask Learning
    Vezhnevets, Alexander
    Buhmann, Joachim M.
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 3249 - 3256
  • [5] Learning Instance Activation Maps for Weakly Supervised Instance Segmentation
    Zhu, Yi
    Zhou, Yanzhao
    Xu, Huijuan
    Ye, Qixiang
    Doermann, David
    Jiao, Jianbin
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3111 - 3120
  • [6] Weakly-Supervised Text Instance Segmentation
    Zu, Xinyan
    Yu, Haiyang
    Li, Bin
    Xue, Xiangyang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1915 - 1923
  • [7] STC: A Simple to Complex Framework for Weakly-Supervised Semantic Segmentation
    Wei, Yunchao
    Liang, Xiaodan
    Chen, Yunpeng
    Shen, Xiaohui
    Cheng, Ming-Ming
    Feng, Jiashi
    Zhao, Yao
    Yan, Shuicheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (11) : 2314 - 2320
  • [8] Weakly Supervised RBM for Semantic Segmentation
    Li, Yong
    Liu, Jing
    Wang, Yuhang
    Lu, Hanqing
    Ma, Songde
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 1888 - 1894
  • [9] A Survey of Weakly -supervised Semantic Segmentation
    Zhu, Kaiyin
    Xiong, Neal N.
    Lu, Mingming
    2023 IEEE 9TH INTL CONFERENCE ON BIG DATA SECURITY ON CLOUD, BIGDATASECURITY, IEEE INTL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, HPSC AND IEEE INTL CONFERENCE ON INTELLIGENT DATA AND SECURITY, IDS, 2023, : 10 - 15
  • [10] Hierarchical Semantic Contrast for Weakly Supervised Semantic Segmentation
    Wu, Yuanchen
    Li, Xiaoqiang
    Dai, Songmin
    Li, Jide
    Liu, Tong
    Xie, Shaorong
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1542 - 1550