FastPathology: An Open-Source Platform for Deep Learning-Based Research and Decision Support in Digital Pathology

被引:8
|
作者
Pedersen, Andre [1 ,3 ]
Valla, Marit [1 ,3 ,4 ]
Bofin, Anna M. [1 ]
De Frutos, Javier Perez [2 ]
Reinertsen, Ingerid [2 ,5 ]
Smistad, Erik [2 ,5 ]
机构
[1] Norwegian Univ Sci & Technol, Dept Clin & Mol Med, N-7491 Trondheim, Norway
[2] SINTEF Med Technol, N-7465 Trondheim, Norway
[3] Trondheim Reg & Univ Hosp, St Olavs Hosp, Clin Surg, N-7030 Trondheim, Norway
[4] Trondheim Reg & Univ Hosp, St Olavs Hosp, Dept Pathol, N-7030 Trondheim, Norway
[5] Norwegian Univ Sci & Technol, Dept Circulat & Med Imaging, N-7491 Trondheim, Norway
来源
IEEE ACCESS | 2021年 / 9卷
关键词
Random access memory; Pathology; Graphics processing units; Open source software; Neural networks; Memory management; Visualization; Deep learning; neural networks; high performance; digital pathology; decision support; TISSUE SEGMENTATION; DISCOVERY; FRAMEWORK;
D O I
10.1109/ACCESS.2021.3072231
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep convolutional neural networks (CNNs) are the current state-of-the-art for digital analysis of histopathological images. The large size of whole-slide microscopy images (WSIs) requires advanced memory handling to read, display and process these images. There are several open-source platforms for working with WSIs, but few support deployment of CNN models. These applications use third-party solutions for inference, making them less user-friendly and unsuitable for high-performance image analysis. To make deployment of CNNs user-friendly and feasible on low-end machines, we have developed a new platform, FastPathology, using the FAST framework and C++. It minimizes memory usage for reading and processing WSIs, deployment of CNN models, and real-time interactive visualization of results. Runtime experiments were conducted on four different use cases, using different architectures, inference engines, hardware configurations and operating systems. Memory usage for reading, visualizing, zooming and panning a WSI were measured, using FastPathology and three existing platforms. FastPathology performed similarly in terms of memory to the other C++-based application, while using considerably less than the two Java-based platforms. The choice of neural network model, inference engine, hardware and processors influenced runtime considerably. Thus, FastPathology includes all steps needed for efficient visualization and processing of WSIs in a single application, including inference of CNNs with real-time display of the results. Source code, binary releases, video demonstrations and test data can be found online on GitHub at https://github.com/SINTEFMedtek/FAST-Pathology/.
引用
收藏
页码:58216 / 58229
页数:14
相关论文
共 50 条
  • [1] ImJoy: an open-source computational platform for the deep learning era
    Ouyang, Wei
    Mueller, Florian
    Hjelmare, Martin
    Lundberg, Emma
    Zimmer, Christophe
    [J]. NATURE METHODS, 2019, 16 (12) : 1199 - 1200
  • [2] ImJoy: an open-source computational platform for the deep learning era
    Wei Ouyang
    Florian Mueller
    Martin Hjelmare
    Emma Lundberg
    Christophe Zimmer
    [J]. Nature Methods, 2019, 16 : 1199 - 1200
  • [3] DeepPull: Deep Learning-Based Approach for Predicting Reopening, Decision, and Lifetime of Pull Requests on GitHub Open-Source Projects
    Banyongrakkul, Peerachai
    Phoomvuthisarn, Suronapee
    [J]. SOFTWARE TECHNOLOGIES, ICSOFT 2023, 2024, 2104 : 100 - 123
  • [4] MWPToolkit: An Open-Source Framework for Deep Learning-Based Math Word Problem Solvers
    Lan, Yihuai
    Wang, Lei
    Zhang, Qiyuan
    Lan, Yunshi
    Dai, Bing Tian
    Wang, Yan
    Zhang, Dongxiang
    Lim, Ee-Peng
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 13188 - 13190
  • [5] Implementing Deep Learning Algorithms in Anatomic Pathology Using Open-source Deep Learning Libraries
    McAlpine, Ewen
    Michelow, Pamela
    [J]. ADVANCES IN ANATOMIC PATHOLOGY, 2020, 27 (04) : 260 - 268
  • [6] An Open-source Based ITS Platform
    Andersen, Ove
    Krogh, Benjamin B.
    Torp, Kristian
    [J]. 2013 IEEE 14TH INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT (MDM 2013), VOL 2, 2013, : 27 - 32
  • [7] pyStudio: An Open-Source Machine Learning Platform
    Gomicia-Murcia, Enrique
    Bordel Sanchez, Borja
    Souissi, Riad
    AL-Qurishi, Muhammad
    [J]. PROCEEDINGS OF THE 2023 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2023, 2023, : 436 - 440
  • [8] NextPyter: Open-Source Research Collaborative Platform
    Faenza, Francesco
    Fregni, Lisa
    Maccaferri, Emiliano
    Canali, Claudia
    [J]. PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2024, PEARC 2024, 2024,
  • [9] DeepFlame: A deep learning empowered open-source platform for reacting flow simulations
    Mao, Runze
    Lin, Minqi
    Zhang, Yan
    Zhang, Tianhan
    Xu, Zhi-Qin John
    Chen, Zhi X.
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 2023, 291
  • [10] DeepRec: An Open-source Toolkit for Deep Learning based Recommendation
    Zhang, Shuai
    Tay, Yi
    Yao, Lina
    Wu, Bin
    Sun, Aixin
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 6581 - 6583