Cloud Deployment of High-Resolution Medical Image Analysis With TOMAAT

被引:10
|
作者
Milletari, Fausto [1 ]
Frei, Johann [2 ,3 ,4 ]
Aboulatta, Moustafa [2 ,3 ,4 ]
Vivar, Gerome [2 ,3 ,4 ]
Ahmadi, Seyed-Ahmad [2 ,3 ,4 ]
机构
[1] Nvidia Inc, Santa Clara, CA 95051 USA
[2] German Ctr Vertigo & Balance Disorders DSGZ, D-81377 Munich, Germany
[3] Ludwig Maximilians Univ Munchen, D-81377 Munich, Germany
[4] Tech Univ Munich Garching, D-85748 Garching, Germany
关键词
Deep learning; medical image analysis; segmentation; registration; cloud deployment; clinical translation; LEFT-VENTRICULAR SEGMENTATION; ALGORITHMS; PLATFORM; MRI;
D O I
10.1109/JBHI.2018.2885214
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Deep learning has been recently applied to a multitude of computer vision and medical image analysis problems. Although recent research efforts have improved the state of the art, most of the methods cannot be easily accessed, compared or used by other researchers or clinicians. Even if developers publish their code and pre-trained models on the internet, integration in stand-alone applications and existing workflows is often not straightforward, especially for clinical research partners. In this paper, we propose an open-source framework to provide AI-enabled medical image analysis through the network. Methods: TOMAAT provides a cloud environment for general medical image analysis, composed of three basic components: (i) an announcement service, maintaining a public registry of (ii) multiple distributed server nodes offering various medical image analysis solutions, and (iii) client software offering simple interfaces for users. Deployment is realized through HTTP-based communication, along with an API and wrappers for common image manipulations during pre- and post-processing. Results: We demonstrate the utility and versatility of TOMAAT on several hallmark medical image analysis tasks: segmentation, diffeomorphic deformable atlas registration, landmark localization, and workflow integration. Through TOMAAT, the high hardware demands, setup and model complexity of demonstrated approaches are transparent to users, who are provided with simple client interfaces. We present example clients in three-dimensional Slicer, in the web browser, on iOS devices and in a commercially available, certified medical image analysis suite. Conclusion: TOMAAT enables deployment of state-of-the-art image segmentation in the cloud, fostering interaction among deep learning researchers and medical collaborators in the clinic. Currently, a public announcement service is hosted by the authors, and several ready-to-use services are registered and enlisted at http://tomaat.cloud.
引用
收藏
页码:969 / 977
页数:9
相关论文
共 50 条
  • [1] HIGH-RESOLUTION IMAGE SIMULATION AND ANALYSIS
    SELF, P
    [J]. REVIEWS IN MINERALOGY, 1992, 27 : 85 - 112
  • [2] HIGH-RESOLUTION IMAGE-ANALYSIS
    PRESTON, K
    [J]. JOURNAL OF HISTOCHEMISTRY & CYTOCHEMISTRY, 1986, 34 (01) : 127 - 127
  • [3] HIGH-RESOLUTION IMAGE-ANALYSIS
    GUNZER, U
    AUS, HM
    HARMS, H
    [J]. JOURNAL OF HISTOCHEMISTRY & CYTOCHEMISTRY, 1987, 35 (06) : 705 - 705
  • [4] HIGH-RESOLUTION IMAGE-ANALYSIS - REPLY
    PRESTON, K
    [J]. JOURNAL OF HISTOCHEMISTRY & CYTOCHEMISTRY, 1987, 35 (06) : 706 - 706
  • [5] High-Resolution Swin Transformer for Automatic Medical Image Segmentation
    Wei, Chen
    Ren, Shenghan
    Guo, Kaitai
    Hu, Haihong
    Liang, Jimin
    [J]. SENSORS, 2023, 23 (07)
  • [6] Mask Embedding for Realistic High-Resolution Medical Image Synthesis
    Ren, Yinhao
    Zhu, Zhe
    Li, Yingzhou
    Kong, Dehan
    Hou, Rui
    Grimm, Lars J.
    Marks, Jeffery R.
    Lo, Joseph Y.
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 422 - 430
  • [7] HIGH-RESOLUTION POINT CLOUD RECONSTRUCTION FROM A SINGLE IMAGE BY REDESCRIPTION
    Wang, Tianshi
    Liu, Li
    Zhang, Huaxiang
    Sun, Jiande
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [8] Cloud Computing Image Processing Application in Athlete Training High-Resolution Image Detection
    Li, Hongtao
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [9] Medical Image Analysis of Rat Sciatic Nerve Anatomy Based on High-Resolution Ultrasound Imaging
    Huang, Yunxia
    Hu, Bing
    Zhu, Jiaan
    [J]. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2017, 7 (04) : 815 - 819
  • [10] HIGH-RESOLUTION IMAGE-ANALYSIS IN CELL BIOLOGY
    NICOLINI, C
    KENDALL, F
    [J]. ACTA MEDICA POLONA, 1982, 23 (3-4) : 155 - 181