Weakly Supervised Cell Segmentation by Point Annotation

被引:38
|
作者
Zhao, Tianyi [1 ]
Yin, Zhaozheng [1 ,2 ,3 ,4 ]
机构
[1] SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA
[2] SUNY Stony Brook, Al Inst, Stony Brook, NY 11794 USA
[3] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA
[4] SUNY Stony Brook, Dept Appl Math & Stat Affiliated, Stony Brook, NY 11794 USA
基金
美国国家科学基金会;
关键词
Image segmentation; Annotations; Training; Neural networks; Task analysis; Deep learning; Computer architecture; Cell segmentation; weakly supervised learning; point annotation; neural networks; human in the loop; UNSUPERVISED SEGMENTATION; IMAGES; PRIORS;
D O I
10.1109/TMI.2020.3046292
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose weakly supervised training schemes to train end-to-end cell segmentation networks that only require a single point annotation per cell as the training label and generate a high-quality segmentation mask close to those fully supervised methods using mask annotation on cells. Three training schemes are investigated to train cell segmentation networks, using the point annotation. First, self-training is performed to learn additional information near the annotated points. Next, co-training is applied to learn more cell regions using multiple networks that supervise each other. Finally, a hybrid-training scheme is proposed to leverage the advantages of both self-training and co-training. During the training process, we propose a divergence loss to avoid the overfitting and a consistency loss to enforce the consensus among multiple co-trained networks. Furthermore, we propose weakly supervised learning with human in the loop, aiming at achieving high segmentation accuracy and annotation efficiency simultaneously. Evaluated on two benchmark datasets, our proposal achieves high-quality cell segmentation results comparable to the fully supervised methods, but with much less amount of human annotation effort.
引用
收藏
页码:2736 / 2747
页数:12
相关论文
共 50 条
  • [31] FedDM: Federated Weakly Supervised Segmentation via Annotation Calibration and Gradient De-Conflicting
    Zhu, Meilu
    Chen, Zhen
    Yuan, Yixuan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (06) : 1632 - 1643
  • [32] Weakly Supervised Instance Segmentation of Electrical Equipment Based on RGB-T Automatic Annotation
    Ma, Jiale
    Qian, Kun
    Zhang, Xiaobo
    Ma, Xudong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) : 9720 - 9731
  • [33] Automatic Annotation for Weakly Supervised Pedestrian Detection
    Garcia-Espinosa, Francisco J.
    Montemayor, Antonio S.
    Cuesta-Infante, Alfredo
    BIO-INSPIRED SYSTEMS AND APPLICATIONS: FROM ROBOTICS TO AMBIENT INTELLIGENCE, PT II, 2022, 13259 : 308 - 317
  • [34] CPCM: Contextual Point Cloud Modeling for Weakly-supervised Point Cloud Semantic Segmentation
    Liu, Lizhao
    Zhuang, Zhuangwei
    Huang, Shangxin
    Xiao, Xunlong
    Xiang, Tianhang
    Chen, Cen
    Wang, Jingdong
    Tan, Mingkui
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18367 - 18376
  • [35] A survey on weakly supervised 3D point cloud semantic segmentation
    Wang, Jingyi
    Liu, Yu
    Tan, Hanlin
    Zhang, Maojun
    IET COMPUTER VISION, 2024, 18 (03) : 329 - 342
  • [36] GECNN for Weakly Supervised Semantic Segmentation of 3D Point Clouds
    He, Zifen
    Zhu, Shouye
    Huang, Ying
    Zhang, Yinhui
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (12) : 2237 - 2243
  • [37] Cross-Cloud Consistency for Weakly Supervised Point Cloud Semantic Segmentation
    Zhang, Yachao
    Lan, Yuxiang
    Xie, Yuan
    Li, Cuihua
    Qu, Yanyun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025,
  • [38] Uncertainty-Guided Contrastive Learning for Weakly Supervised Point Cloud Segmentation
    Yao, Baochen
    Dong, Li
    Qiu, Xiaojie
    Song, Kangkang
    Yan, Diqun
    Peng, Chengbin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [39] Less Is More: Label Recommendation for Weakly Supervised Point Cloud Semantic Segmentation
    Pan, Zhiyi
    Zhang, Nan
    Gao, Wei
    Liu, Shan
    Li, Ge
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4397 - 4405
  • [40] EXPLORING LABEL INITIALIZATION FOR WEAKLY SUPERVISED ALS POINT CLOUD SEMANTIC SEGMENTATION
    Wang, Puzuo
    Yao, Wei
    XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 5-2 : 151 - 158