medigan: a Python']Python library of pretrained generative models for medical image synthesis

被引:8
|
作者
Osuala, Richard [1 ]
Skorupko, Grzegorz [1 ]
Lazrak, Noussair [1 ]
Garrucho, Lidia [1 ]
Garcia, Eloy [2 ]
Joshi, Smriti [1 ]
Jouide, Socayna [1 ]
Rutherford, Michael [3 ]
Prior, Fred [3 ]
Kushibar, Kaisar [1 ]
Diaz, Oliver [1 ]
Lekadir, Karim [1 ]
机构
[1] Univ Barcelona, Barcelona Artificial Intelligence Med Lab BCN AIM, Fac Matemat & Informat, Barcelona, Spain
[2] Univ Barcelona, Fac Matemat & Informat, Barcelona, Spain
[3] Univ Arkansas Med Sci, Dept Biomed Informat, Little Rock, AR USA
关键词
synthetic data; generative adversarial networks; !text type='Python']Python[!/text; image synthesis; deep learning; NETWORKS; DATASET;
D O I
10.1117/1.JMI.10.6.061403
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: Deep learning has shown great promise as the backbone of clinical decision support systems. Synthetic data generated by generative models can enhance the performance and capabilities of data-hungry deep learning models. However, there is (1) limited availability of (synthetic) datasets and (2) generative models are complex to train, which hinders their adoption in research and clinical applications. To reduce this entry barrier, we explore generative model sharing to allow more researchers to access, generate, and benefit from synthetic data.Approach: We propose medigan, a one-stop shop for pretrained generative models implemented as an open-source framework-agnostic Python library. After gathering end-user requirements, design decisions based on usability, technical feasibility, and scalability are formulated. Subsequently, we implement medigan based on modular components for generative model (i) execution, (ii) visualization, (iii) search & ranking, and (iv) contribution. We integrate pretrained models with applications across modalities such as mammography, endoscopy, x-ray, and MRI.Results: The scalability and design of the library are demonstrated by its growing number of integrated and readily-usable pretrained generative models, which include 21 models utilizing nine different generative adversarial network architectures trained on 11 different datasets. We further analyze three medigan applications, which include (a) enabling community-wide sharing of restricted data, (b) investigating generative model evaluation metrics, and (c) improving clinical downstream tasks. In (b), we extract Frechet inception distances (FID) demonstrating FID variability based on image normalization and radiology-specific feature extractors.Conclusion: medigan allows researchers and developers to create, increase, and domain-adapt their training data in just a few lines of code. Capable of enriching and accelerating the development of clinical machine learning models, we show medigan's viability as platform for generative model sharing. Our multimodel synthetic data experiments uncover standards for assessing and reporting metrics, such as FID, in image synthesis studies.
引用
收藏
页数:28
相关论文
共 50 条
  • [1] Pixyz: a Python']Python library for developing deep generative models
    Suzuki, Masahiro
    Kaneko, Takaaki
    Matsuo, Yutaka
    [J]. ADVANCED ROBOTICS, 2023, 37 (19) : 1221 - 1236
  • [2] DaVaW:: A python']python library for medical image processing applications
    Regrain, B
    Boix, E
    Odet, C
    Benoit-Cattin, H
    [J]. 2005 International Conference on Image Processing (ICIP), Vols 1-5, 2005, : 2993 - 2996
  • [3] ParetoLib: A Python']Python Library for Parameter Synthesis
    Bakhirkin, Alexey
    Basset, Nicolas
    Maler, Oded
    Jarabo, Jose-Ignacio Requeno
    [J]. FORMAL MODELING AND ANALYSIS OF TIMED SYSTEMS (FORMATS 2019), 2019, 11750 : 114 - 120
  • [4] IDALib: a Python']Python library for efficient image data augmentation
    Vila-Blanco, Nicolas
    Vilas, Raquel R.
    Carreira, Maria J.
    [J]. 2022 10TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2022,
  • [5] Analyzing microtomography data with Python']Python and the scikit-image library
    Gouillart, Emmanuelle
    Nunez-Iglesias, Juan
    van der Walt, Stefan
    [J]. ADVANCED STRUCTURAL AND CHEMICAL IMAGING, 2016, 2
  • [6] Creating a python']python GUI for a C++ image processing library
    Wuth, SN
    Coetzee, R
    Levitt, SP
    [J]. 2004 IEEE AFRICON: 7TH AFRICON CONFERENCE IN AFRICA, VOLS 1 AND 2: TECHNOLOGY INNOVATION, 2004, : 1203 - 1206
  • [7] NQLib: A Python']Python library for noise-shaping quantizer synthesis
    Tanaka, Kenta
    Minami, Yuki
    Ishikawa, Masato
    [J]. SOFTWAREX, 2024, 27
  • [8] PyDPLib: Python']Python Differential Privacy Library for Private Medical Data Analytics
    Imtiaz, Sana
    Matthies, Philipp
    Pinto, Francisco
    Maros, Mate
    Wenz, Holger
    Sadre, Ramin
    Vlassov, Vladimir
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON DIGITAL HEALTH (ICDH 2021), 2021, : 191 - 196
  • [9] APLUS: A Python']Python library for usefulness simulations of machine learning models in healthcare
    Wornow, Michael
    Ross, Elsie Gyang
    Callahan, Alison
    Shah, Nigam H.
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2023, 139
  • [10] PostBP: A Python']Python library to analyze outputs from wildfire growth models
    Liu, Ning
    Yemshanov, Denys
    Parisien, Marc-Andre
    Stockdale, Chris
    Moore, Brett
    Koch, Frank H.
    [J]. METHODSX, 2024, 13