Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

被引:80
|
作者
Zhong, Yuanyi [1 ]
Yuan, Bodi [2 ]
Wu, Hong [2 ]
Yuan, Zhiqiang [2 ]
Peng, Jian [1 ]
Wang, Yu-Xiong [1 ]
机构
[1] Univ Illinois, Urbana, IL 61820 USA
[2] X Moonshot Factory, Boston, MA USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCV48922.2021.00718
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-space contrastive property among different pixels. We leverage the pixel-level l(2) loss and the pixel contrastive loss for the two purposes respectively. To address the computational efficiency issue and the false negative noise issue involved in the pixel contrastive loss, we further introduce and investigate several negative sampling techniques. Extensive experiments demonstrate the state-of-the-art performance of our method (PC(2)Seg) with the DeepLab-v3+ architecture, in several challenging semi-supervised settings derived from the VOC, Cityscapes, and COCO datasets.
引用
收藏
页码:7253 / 7262
页数:10
相关论文
共 50 条
  • [1] Adversarial Dense Contrastive Learning for Semi-Supervised Semantic Segmentation
    Wang, Ying
    Xuan, Ziwei
    Ho, Chiuman
    Qi, Guo-Jun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4459 - 4471
  • [2] Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning
    Chen, Zenggui
    Lian, Zhouhui
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6696 - 6705
  • [3] PRCL: Probabilistic Representation Contrastive Learning for Semi-Supervised Semantic Segmentation
    Xie, Haoyu
    Wang, Changqi
    Zhao, Jian
    Liu, Yang
    Dan, Jun
    Fu, Chong
    Sun, Baigui
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (10) : 4343 - 4361
  • [4] Semi-Supervised Pixel Contrastive Learning Framework for Tissue Segmentation in Histopathological Image
    Shi, Jiangbo
    Gong, Tieliang
    Wang, Chunbao
    Li, Chen
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (01) : 97 - 108
  • [5] Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network
    Wang, Jia-Xin
    Chen, Si-Bao
    Ding, Chris H. Q.
    Tang, Jin
    Luo, Bin
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [6] Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
    Jiang, Li
    Shi, Shaoshuai
    Tian, Zhuotao
    Lai, Xin
    Liu, Shu
    Fu, Chi-Wing
    Jia, Jiaya
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6403 - 6412
  • [7] Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bank
    Alonso, Inigo
    Sabater, Alberto
    Ferstl, David
    Montesano, Luis
    Murillo, Ana C.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8199 - 8208
  • [8] Transferable Semi-Supervised Semantic Segmentation
    Xiao, Huaxin
    Wei, Yunchao
    Liu, Yu
    Zhang, Maojun
    Feng, Jiashi
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7420 - 7427
  • [9] Universal Semi-Supervised Semantic Segmentation
    Kalluri, Tarun
    Varma, Girish
    Chandraker, Manmohan
    Jawahar, C. V.
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5258 - 5269
  • [10] Saliency as Pseudo-Pixel Supervision for Weakly and Semi-Supervised Semantic Segmentation
    Lee, Minhyun
    Lee, Seungho
    Lee, Jongwuk
    Shim, Hyunjung
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 12341 - 12357