Embedding-based Instance Segmentation in Microscopy

被引:0
|
作者
Lalit, Manan [1 ,2 ]
Tomancak, Pavel [1 ,2 ,3 ]
Jug, Florian [1 ,2 ,4 ]
机构
[1] CSBD, Dresden, Germany
[2] Max Planck Inst Mol Cell Biol & Genet, Dresden, Germany
[3] VSB Tech Univ Ostrava, IT4Innovat, Ostrava, Czech Republic
[4] Fdn Human Technopole, Milan, Italy
关键词
instance segmentation; microscopy; spatial embeddings; deep learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic detection and segmentation of objects in 2D and 3D microscopy data is important for countless biomedical applications. In the natural image domain, spatial embeddingbased instance segmentation methods are known to yield high-quality results, but their utility for segmenting microscopy data is currently little researched. Here we introduce EmbedSeg, an embedding-based instance segmentation method which outperforms existing state-of-the-art baselines on 2D as well as 3D microscopy datasets. Additionally, we show that EmbedSeg has a GPU memory footprint small enough to train even on laptop GPUs, making it accessible to virtually everyone. Finally, we introduce four new 3D microscopy datasets, which we make publicly available alongside ground truth training labels. Our open-source implementation is available at https://github.com/juglab/EmbedSeg.
引用
收藏
页码:399 / 415
页数:17
相关论文
共 50 条
  • [1] EMBEDSEG: Embedding-based Instance Segmentation for Biomedical Microscopy Data
    Lalit, Manan
    Tomancak, Pavel
    Jug, Florian
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 81
  • [2] Deep learning embedding-based segmentation for morphological analysis in organoids
    Sureshkumar, Akash
    Bisht, Shilpa
    Easwaran, Hariharan
    [J]. CANCER RESEARCH, 2024, 84 (06)
  • [3] EmbedMask: Embedding Coupling for Instance Segmentation
    Ying, Hui
    Huang, Zhaojin
    Liu, Shu
    Shao, Tianjia
    Zhou, Kun
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1266 - 1273
  • [4] ISTR: Mask-Embedding-Based Instance Segmentation Transformer
    Hu, Jie
    Lu, Yao
    Zhang, Shengchuan
    Cao, Liujuan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 2895 - 2907
  • [5] Learning Instance Motion Segmentation With Geometric Embedding
    Leng, Zhen
    Chen, Jing
    Lin, Songnan
    [J]. IEEE ACCESS, 2021, 9 : 56812 - 56821
  • [6] Dual Embedding Learning for Video Instance Segmentation
    Feng, Qianyu
    Yang, Zongxin
    Li, Peike
    Wei, Yunchao
    Yang, Yi
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 717 - 720
  • [7] Embedding-based search in JetBrains IDEs
    Abramov, Evgeny
    Palchikov, Nikolai
    [J]. PROCEEDINGS OF THE 2024 FIRST IDE WORKSHOP, IDE 2024, 2024, : 62 - 65
  • [8] Trilattice logic: an embedding-based approach
    Kamide, Norihiro
    [J]. JOURNAL OF LOGIC AND COMPUTATION, 2015, 25 (03) : 581 - 611
  • [9] Embedding-based Representation of Signal Distances
    Boufounos, Petros T.
    Rane, Shantanu
    [J]. 2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 625 - 625
  • [10] Binary Embedding-based Retrieval at Tencent
    Gan, Yukang
    Ge, Yixiao
    Zhou, Chang
    Su, Shupeng
    Xu, Zhouchuan
    Xu, Xuyuan
    Hui, Quanchao
    Chen, Xiang
    Wang, Yexin
    Shan, Ying
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 4056 - 4067