Contrastive Learning for Mitochondria Segmentation

被引:9
|
作者
Li, Zhili [1 ,2 ]
Chen, Xuejin [1 ,2 ]
Zhao, Jie [1 ,2 ]
Xiong, Zhiwei [1 ,2 ]
机构
[1] Univ Sci & Technol China, Natl Engn Lab Brain Inspired Intelligence Technol, Hefei, Peoples R China
[2] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Electron Microscopy; Mitochondria; Image Segmentation; Contrastive Learning;
D O I
10.1109/EMBC46164.2021.9630350
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise, artifacts and other sub-cellular structures, mitochondria segmentation is very challenging. In this paper, we propose a novel and effective contrastive learning framework to learn a better feature representation from hard examples to improve segmentation. Specifically, we adopt a point sampling strategy to pick out representative pixels from hard examples in the training phase. Based on these sampled pixels, we introduce a pixel-wise label-based contrastive loss which consists of a similarity loss term and a consistency loss term. The similarity term can increase the similarity of pixels from the same class and the separability of pixels from different classes in feature space, while the consistency term is able to enhance the sensitivity of the 3D model to changes in image content from frame to frame. We demonstrate the effectiveness of our method on MitoEM dataset as well as FIB-SEM dataset and show better or on par with state-of-the-art results.
引用
收藏
页码:3496 / 3500
页数:5
相关论文
共 50 条
  • [1] Instance Segmentation of Shrimp Based on Contrastive Learning
    Zhou, Heng
    Kim, Sung Hoon
    Kim, Sang Cheol
    Kim, Cheol Won
    Kang, Seung Won
    Kim, Hyongsuk
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [2] CONTRASTIVE TRANSLATION LEARNING FOR MEDICAL IMAGE SEGMENTATION
    Zeng, Wankang
    Fan, Wenkang
    Shen, Dongfang
    Chen, Yinran
    Luo, Xiongbiao
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2395 - 2399
  • [3] Contrastive Learning for Label Efficient Semantic Segmentation
    Zhao, Xiangyun
    Vemulapalli, Raviteja
    Mansfield, Philip Andrew
    Gong, Boqing
    Green, Bradley
    Shapira, Lior
    Wu, Ying
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10603 - 10613
  • [4] Distributed contrastive learning for medical image segmentation
    Wu, Yawen
    Zeng, Dewen
    Wang, Zhepeng
    Shi, Yiyu
    Hu, Jingtong
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 81
  • [5] Guided contrastive boundary learning for semantic segmentation
    Qiu, Shoumeng
    Chen, Jie
    Zhang, Haiqiang
    Wan, Ru
    Xue, Xiangyang
    Pu, Jian
    [J]. PATTERN RECOGNITION, 2024, 155
  • [6] Contrastive Boundary Learning for Point Cloud Segmentation
    Tang, Liyao
    Zhan, Yibing
    Chen, Zhe
    Yu, Baosheng
    Tao, Dacheng
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8479 - 8489
  • [7] Positional Contrastive Learning for Volumetric Medical Image Segmentation
    Zeng, Dewen
    Wu, Yawen
    Hu, Xinrong
    Xu, Xiaowei
    Yuan, Haiyun
    Huang, Meiping
    Zhuang, Jian
    Hu, Jingtong
    Shi, Yiyu
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 221 - 230
  • [8] Federated Contrastive Learning for Volumetric Medical Image Segmentation
    Wu, Yawen
    Zeng, Dewen
    Wang, Zhepeng
    Shi, Yiyu
    Hu, Jingtong
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT III, 2021, 12903 : 367 - 377
  • [9] TSCL: Timestamp Supervised Contrastive Learning for Action Segmentation
    Patsch, Constantin
    Wu, Yuankai
    Salihu, Driton
    Zakour, Marsil
    Steinbach, Eckehard
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7485 - 7492
  • [10] Region-aware Contrastive Learning for Semantic Segmentation
    Hu, Hanzhe
    Cui, Jinshi
    Wang, Liwei
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 16271 - 16281