A benchmark for comparison of cell tracking algorithms

被引:282
|
作者
Maska, Martin [1 ,2 ]
Ulman, Vladimir [1 ]
Svoboda, David [1 ]
Matula, Pavel [1 ]
Matula, Petr [1 ]
Ederra, Cristina [2 ]
Urbiola, Ainhoa [2 ]
Espana, Tomas [2 ]
Venkatesan, Subramanian [3 ]
Balak, Deepak M. W. [3 ]
Karas, Pavel [1 ]
Bolckova, Tereza [1 ]
Streitova, Marketa [1 ]
Carthel, Craig [4 ]
Coraluppi, Stefano [4 ]
Harder, Nathalie [5 ,6 ]
Rohr, Karl [5 ,6 ]
Magnusson, Klas E. G. [7 ]
Jalden, Joakim [7 ]
Blau, Helen M. [8 ]
Dzyubachyk, Oleh [9 ]
Krizek, Pavel [10 ]
Hagen, Guy M. [10 ]
Pastor-Escuredo, David [11 ,12 ]
Jimenez-Carretero, Daniel [11 ,12 ]
Ledesma-Carbayo, Maria J. [11 ,12 ]
Munoz-Barrutia, Arrate [2 ]
Meijering, Erik [3 ]
Kozubek, Michal [1 ]
Ortiz-de-Solorzano, Carlos [2 ]
机构
[1] Masaryk Univ, Ctr Biomed Image Anal, Brno 60200, Czech Republic
[2] Univ Navarra, Ctr Appl Med Res, Canc Imaging Lab, Div Oncol, Pamplona 31008, Spain
[3] Erasmus Univ, Med Ctr, Biomed Imaging Grp Rotterdam, NL-3015 GE Rotterdam, Netherlands
[4] Compunetix Inc, Fus Technol & Syst Dept, Monroeville, PA 15146 USA
[5] Heidelberg Univ, BIOQUANT, IPMB, Biomed Comp Vis Grp,Dept Bioinformat & Funct Geno, D-69120 Heidelberg, Germany
[6] DKFZ, D-69120 Heidelberg, Germany
[7] KTH Royal Inst Technol, ACCESS Linnaeus Ctr, Dept Signal Proc, S-10044 Stockholm, Sweden
[8] Stanford Univ, Sch Med, Inst Stem Cell Biol & Regenerat Med, Baxter Lab Stem Cell Biol,Dept Microbiol & Immuno, Stanford, CA 94305 USA
[9] Leiden Univ, Med Ctr, Div Image Proc, NL-2300 RC Leiden, Netherlands
[10] Charles Univ Prague, Fac Med 1, Inst Cellular Biol & Pathol, Prague 12801 2, Czech Republic
[11] Univ Politecn Madrid, E-28040 Madrid, Spain
[12] CIBER BBN, Madrid 28040, Spain
基金
美国国家卫生研究院; 瑞典研究理事会;
关键词
LINEAGE CONSTRUCTION; MICROSCOPY IMAGES; SEGMENTATION; NUCLEI;
D O I
10.1093/bioinformatics/btu080
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Motivation: Automatic tracking of cells in multidimensional time-lapse fluorescence microscopy is an important task in many biomedical applications. A novel framework for objective evaluation of cell tracking algorithms has been established under the auspices of the IEEE International Symposium on Biomedical Imaging 2013 Cell Tracking Challenge. In this article, we present the logistics, datasets, methods and results of the challenge and lay down the principles for future uses of this benchmark. Results: The main contributions of the challenge include the creation of a comprehensive video dataset repository and the definition of objective measures for comparison and ranking of the algorithms. With this benchmark, six algorithms covering a variety of segmentation and tracking paradigms have been compared and ranked based on their performance on both synthetic and real datasets. Given the diversity of the datasets, we do not declare a single winner of the challenge. Instead, we present and discuss the results for each individual dataset separately.
引用
收藏
页码:1609 / 1617
页数:9
相关论文
共 50 条
  • [1] An objective comparison of cell-tracking algorithms
    Ulman, Vladimir
    Maska, Martin
    Magnusson, Klas E. G.
    Ronneberger, Olaf
    Haubold, Carsten
    Harder, Nathalie
    Matula, Pavel
    Matula, Petr
    Svoboda, David
    Radojevic, Miroslav
    Smal, Ihor
    Rohr, Karl
    Jalden, Joakim
    Blau, Helen M.
    Dzyubachyk, Oleh
    Lelieveldt, Boudewijn
    Xiao, Pengdong
    Li, Yuexiang
    Cho, Siu-Yeung
    Dufour, Alexandre C.
    Olivo-Marin, Jean-Christophe
    Reyes-Aldasoro, Constantino C.
    Solis-Lemus, Jose A.
    Bensch, Robert
    Brox, Thomas
    Stegmaier, Johannes
    Mikut, Ralf
    Wolf, Steffen
    Hamprecht, Fred A.
    Esteves, Tiago
    Quelhas, Pedro
    Demirel, Omer
    Malmstrom, Lars
    Jug, Florian
    Tomancak, Pavel
    Meijering, Erik
    Munoz-Barrutia, Arrate
    Kozubek, Michal
    Ortiz-de-Solorzano, Carlos
    [J]. NATURE METHODS, 2017, 14 (12) : 1141 - +
  • [2] An objective comparison of cell-tracking algorithms
    Vladimír Ulman
    Martin Maška
    Klas E G Magnusson
    Olaf Ronneberger
    Carsten Haubold
    Nathalie Harder
    Pavel Matula
    Petr Matula
    David Svoboda
    Miroslav Radojevic
    Ihor Smal
    Karl Rohr
    Joakim Jaldén
    Helen M Blau
    Oleh Dzyubachyk
    Boudewijn Lelieveldt
    Pengdong Xiao
    Yuexiang Li
    Siu-Yeung Cho
    Alexandre C Dufour
    Jean-Christophe Olivo-Marin
    Constantino C Reyes-Aldasoro
    Jose A Solis-Lemus
    Robert Bensch
    Thomas Brox
    Johannes Stegmaier
    Ralf Mikut
    Steffen Wolf
    Fred A Hamprecht
    Tiago Esteves
    Pedro Quelhas
    Ömer Demirel
    Lars Malmström
    Florian Jug
    Pavel Tomancak
    Erik Meijering
    Arrate Muñoz-Barrutia
    Michal Kozubek
    Carlos Ortiz-de-Solorzano
    [J]. Nature Methods, 2017, 14 : 1141 - 1152
  • [3] A BENCHMARK FOR ROBUSTNESS ANALYSIS OF VISUAL TRACKING ALGORITHMS
    Fang, Yuming
    Yuan, Yuan
    Xu, Long
    Lin, Weisi
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1120 - 1124
  • [4] A Benchmark for Epithelial Cell Tracking
    Funke, Jan
    Mais, Lisa
    Champion, Andrew
    Dye, Natalie
    Kainmueller, Dagmar
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 437 - 445
  • [5] Encoding Color Information for Visual Tracking: Algorithms and Benchmark
    Liang, Pengpeng
    Blasch, Erik
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 5630 - 5644
  • [6] A benchmark for comparison of dental radiography analysis algorithms
    Wang, Ching-Wei
    Huang, Cheng-Ta
    Lee, Jia-Hong
    Li, Chung-Hsing
    Chang, Sheng-Wei
    Siao, Ming-Jhih
    Lai, Tat-Ming
    Ibragimov, Bulat
    Vrtovec, Tomaz
    Ronneberger, Olaf
    Fischer, Philipp
    Cootes, Tim F.
    Lindner, Claudia
    [J]. MEDICAL IMAGE ANALYSIS, 2016, 31 : 63 - 76
  • [7] Comparison of decentralized tracking algorithms
    Wah, NG
    Rong, Y
    [J]. FUSION 2003: PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE OF INFORMATION FUSION, VOLS 1 AND 2, 2003, : 107 - 113
  • [8] γ-ray tracking algorithms:: a comparison
    Lopez-Martens, A
    Hauschild, K
    Korichi, A
    Roccaz, J
    Thibaud, JP
    [J]. NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2004, 533 (03): : 454 - 466
  • [9] Range tracking & comparison algorithms
    Krauss, KJ
    [J]. DR DOBBS JOURNAL, 2006, 31 (02): : 50 - 51
  • [10] A Comparison of Algorithms for Handheld Wand Tracking
    Wolfe, Britton
    Gloudemans, Monica
    [J]. APPLIED ARTIFICIAL INTELLIGENCE, 2014, 28 (09) : 888 - 915