Weakly Supervised Cell Segmentation by Point Annotation

被引:38
|
作者
Zhao, Tianyi [1 ]
Yin, Zhaozheng [1 ,2 ,3 ,4 ]
机构
[1] SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA
[2] SUNY Stony Brook, Al Inst, Stony Brook, NY 11794 USA
[3] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA
[4] SUNY Stony Brook, Dept Appl Math & Stat Affiliated, Stony Brook, NY 11794 USA
基金
美国国家科学基金会;
关键词
Image segmentation; Annotations; Training; Neural networks; Task analysis; Deep learning; Computer architecture; Cell segmentation; weakly supervised learning; point annotation; neural networks; human in the loop; UNSUPERVISED SEGMENTATION; IMAGES; PRIORS;
D O I
10.1109/TMI.2020.3046292
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We propose weakly supervised training schemes to train end-to-end cell segmentation networks that only require a single point annotation per cell as the training label and generate a high-quality segmentation mask close to those fully supervised methods using mask annotation on cells. Three training schemes are investigated to train cell segmentation networks, using the point annotation. First, self-training is performed to learn additional information near the annotated points. Next, co-training is applied to learn more cell regions using multiple networks that supervise each other. Finally, a hybrid-training scheme is proposed to leverage the advantages of both self-training and co-training. During the training process, we propose a divergence loss to avoid the overfitting and a consistency loss to enforce the consensus among multiple co-trained networks. Furthermore, we propose weakly supervised learning with human in the loop, aiming at achieving high segmentation accuracy and annotation efficiency simultaneously. Evaluated on two benchmark datasets, our proposal achieves high-quality cell segmentation results comparable to the fully supervised methods, but with much less amount of human annotation effort.
引用
收藏
页码:2736 / 2747
页数:12
相关论文
共 50 条
  • [11] Weakly Supervised Deep Nuclei Segmentation using Points Annotation in Histopathology Images
    Qu, Hui
    Wu, Pengxiang
    Huang, Qiaoying
    Yi, Jingru
    Riedlinger, Gregory M.
    De, Subhajyoti
    Metaxas, Dimitris N.
    INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 102, 2019, 102 : 390 - 400
  • [12] Dual Adaptive Transformations for Weakly Supervised Point Cloud Segmentation
    Wu, Zhonghua
    Wu, Yicheng
    Lin, Guosheng
    Cai, Jianfei
    Qian, Chen
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 78 - 96
  • [13] Weakly supervised glottis segmentation on endoscopic images with point supervision
    Wei, Xiaoxiao
    Deng, Zhen
    Zheng, Xiaochun
    He, Bingwei
    Hu, Ying
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 92
  • [14] Weakly Supervised Histopathology Image Segmentation With Sparse Point Annotations
    Chen, Zhe
    Chen, Zhao
    Liu, Jingxin
    Zheng, Qiang
    Zhu, Yuang
    Zuo, Yanfei
    Wang, Zhaoyu
    Guan, Xiaosong
    Wang, Yue
    Li, Yuan
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (05) : 1673 - 1685
  • [15] PCL: Point Contrast and Labeling for Weakly Supervised Point Cloud Semantic Segmentation
    Du, Anan
    Zhou, Tianfei
    Pang, Shuchao
    Wu, Qiang
    Zhang, Jian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8902 - 8914
  • [16] Weakly Supervised Segmentation of COVID19 Infection with Scribble Annotation on CT Images
    Liu, Xiaoming
    Yuan, Quan
    Gao, Yaozong
    He, Kelei
    Wang, Shuo
    Tang, Xiao
    Tang, Jinshan
    Shen, Dinggang
    PATTERN RECOGNITION, 2022, 122
  • [17] Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images
    Qu, Hui
    Wu, Pengxiang
    Huang, Qiaoying
    Yi, Jingru
    Yan, Zhennan
    Li, Kang
    Riedlinger, Gregory M.
    De, Subhajyoti
    Zhang, Shaoting
    Metaxas, Dimitris N.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (11) : 3655 - 3666
  • [18] Pixel-level tunnel crack segmentation using a weakly supervised annotation approach
    Wang, Hanxiang
    Li, Yanfen
    Dang, L. Minh
    Lee, Sujin
    Moon, Hyeonjoon
    COMPUTERS IN INDUSTRY, 2021, 133
  • [19] Mining confident supervision by prototypes discovering and annotation selection for weakly supervised semantic segmentation
    Zhou, Lei
    Chen, Huagui
    Wei, Yufeng
    Li, Xiaoxiao
    NEUROCOMPUTING, 2022, 501 : 420 - 435
  • [20] Weakly supervised semantic segmentation of airborne laser scanning point clouds
    Lin, Yaping
    Vosselman, George
    Yang, Michael Ying
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 187 : 79 - 100