Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

被引:80
|
作者
Zhong, Yuanyi [1 ]
Yuan, Bodi [2 ]
Wu, Hong [2 ]
Yuan, Zhiqiang [2 ]
Peng, Jian [1 ]
Wang, Yu-Xiong [1 ]
机构
[1] Univ Illinois, Urbana, IL 61820 USA
[2] X Moonshot Factory, Boston, MA USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCV48922.2021.00718
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-space contrastive property among different pixels. We leverage the pixel-level l(2) loss and the pixel contrastive loss for the two purposes respectively. To address the computational efficiency issue and the false negative noise issue involved in the pixel contrastive loss, we further introduce and investigate several negative sampling techniques. Extensive experiments demonstrate the state-of-the-art performance of our method (PC(2)Seg) with the DeepLab-v3+ architecture, in several challenging semi-supervised settings derived from the VOC, Cityscapes, and COCO datasets.
引用
收藏
页码:7253 / 7262
页数:10
相关论文
共 50 条
  • [21] A contrastive consistency semi-supervised left atrium segmentation model
    Liu, Yashu
    Wang, Wei
    Luo, Gongning
    Wang, Kuanquan
    Li, Shuo
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2022, 99
  • [22] A Residual Correction Approach for Semi-supervised Semantic Segmentation
    Li, Haoliang
    Zheng, Huicheng
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PT IV, 2021, 13022 : 90 - 102
  • [23] ROBUST ADVERSARIAL LEARNING FOR SEMI-SUPERVISED SEMANTIC SEGMENTATION
    Zhang, Jia
    Li, Zhixin
    Zhang, Canlong
    Ma, Huifang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 728 - 732
  • [24] SEMI-SUPERVISED SEMANTIC SEGMENTATION CONSTRAINED BY CONSISTENCY REGULARIZATION
    Li, Xiaoqiang
    He, Qin
    Dai, Songmin
    Wu, Pin
    Tong, Weiqin
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [25] Semi-supervised Learning for Segmentation Under Semantic Constraint
    Ganaye, Pierre-Antoine
    Sdika, Michael
    Benoit-Cattin, Hugues
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, PT III, 2018, 11072 : 595 - 602
  • [26] Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision
    Chen, Xiaokang
    Yuan, Yuhui
    Zeng, Gang
    Wang, Jingdong
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2613 - 2622
  • [27] Semi-supervised Semantic Segmentation with Complementary Reconfirmation Mechanism
    Xiao, Yifan
    Dong, Jing
    Zhang, Qiang
    Yi, Pengfei
    Liu, Rui
    Wei, Xiaopeng
    [J]. ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, UKCI 2023, 2024, 1453 : 182 - 194
  • [28] Fuzzy Positive Learning for Semi-supervised Semantic Segmentation
    Qiao, Pengchong
    Wei, Zhidan
    Wang, Yu
    Wang, Zhennan
    Song, Guoli
    Xu, Fan
    Ji, Xiangyang
    Liu, Chang
    Chen, Jie
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15465 - 15474
  • [29] Semi-supervised Semantic Segmentation with Mutual Knowledge Distillation
    Yuan, Jianlong
    Ge, Jinchao
    Wang, Zhibin
    Liu, Yifan
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5436 - 5444
  • [30] Catastrophic Forgetting Problem in Semi-Supervised Semantic Segmentation
    Zhou, Yan
    Jiao, Ruyi
    Wang, Dongli
    Mu, Jinzhen
    Li, Jianxun
    [J]. IEEE ACCESS, 2022, 10 : 48855 - 48864