DeepFake knee osteoarthritis X-rays from generative adversarial neural networks deceive medical experts and offer augmentation potential to automatic classification

被引:22
|
作者
Prezja, Fabi [1 ]
Paloneva, Juha [2 ,3 ]
Polonen, Ilkka [1 ]
Niinimaki, Esko [1 ]
Ayramo, Sami [1 ]
机构
[1] Univ Jyvaskyla, Fac Informat Technol, Jyvaskyla 40014, Finland
[2] Cent Finland Healthcare Dist, Dept Surg, Jyvaskyla 40620, Finland
[3] Univ Eastern Finland, Sch Med, Kuopio 70211, Finland
关键词
SHAPE; GAN;
D O I
10.1038/s41598-022-23081-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Recent developments in deep learning have impacted medical science. However, new privacy issues and regulatory frameworks have hindered medical data sharing and collection. Deep learning is a very data-intensive process for which such regulatory limitations limit the potential for new breakthroughs and collaborations. However, generating medically accurate synthetic data can alleviate privacy issues and potentially augment deep learning pipelines. This study presents generative adversarial neural networks capable of generating realistic images of knee joint X-rays with varying osteoarthritis severity. We offer 320,000 synthetic (DeepFake) X-ray images from training with 5,556 real images. We validated our models regarding medical accuracy with 15 medical experts and for augmentation effects with an osteoarthritis severity classification task. We devised a survey of 30 real and 30 DeepFake images for medical experts. The result showed that on average, more DeepFakes were mistaken for real than the reverse. The result signified sufficient DeepFake realism for deceiving the medical experts. Finally, our DeepFakes improved classification accuracy in an osteoarthritis severity classification task with scarce real data and transfer learning. In addition, in the same classification task, we replaced all real training data with DeepFakes and suffered only a 3.79% loss from baseline accuracy in classifying real osteoarthritis X-rays.
引用
收藏
页数:16
相关论文
共 8 条
  • [1] DeepFake knee osteoarthritis X-rays from generative adversarial neural networks deceive medical experts and offer augmentation potential to automatic classification
    Fabi Prezja
    Juha Paloneva
    Ilkka Pölönen
    Esko Niinimäki
    Sami Äyrämö
    Scientific Reports, 12
  • [2] Data Augmentation using Generative Adversarial Networks for Pneumonia classification in chest X-rays
    Bhagat, Vedant
    Bhaumik, Swapnil
    2019 FIFTH INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP 2019), 2019, : 574 - 579
  • [3] AUTOMATIC COMPUTATION OF KNEE OSTEOARTHRITIS SEVERITY USING KNEE X-RAYS AND CONVOLUTIONAL NEURAL NETWORKS
    Selmi, T. Ait Si
    Muller-Fouarge, F.
    Estienne, T.
    Bekadar, S.
    Carrillon, Y.
    Pouchy, C.
    Bonnin, M.
    ANNALS OF THE RHEUMATIC DISEASES, 2023, 82 : 753 - 753
  • [4] GENERALIZATION OF DEEP NEURAL NETWORKS FOR CHEST PATHOLOGY CLASSIFICATION IN X-RAYS USING GENERATIVE ADVERSARIAL NETWORKS
    Salehinejad, Hojjat
    Valaee, Shahrokh
    Dowdell, Tim
    Colak, Errol
    Barfett, Joseph
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 990 - 994
  • [5] X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networks
    Ying, Xingde
    Guo, Heng
    Ma, Kai
    Wu, Jian
    Weng, Zhengxin
    Zheng, Yefeng
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10611 - 10620
  • [6] TRCT-GAN: CT reconstruction from biplane X-rays using transformer and generative adversarial networks
    Wang, Yufeng
    Sun, Zhan-Li
    Zeng, Zhigang
    Lam, Kin-Man
    DIGITAL SIGNAL PROCESSING, 2023, 140
  • [7] Synthetic 3D Spinal Vertebrae Reconstruction from Biplanar X-rays Utilizing Generative Adversarial Networks
    Saravi, Babak
    Guzel, Hamza Eren
    Zink, Alisia
    Uelkuemen, Sara
    Couillard-Despres, Sebastien
    Wollborn, Jakob
    Lang, Gernot
    Hassel, Frank
    JOURNAL OF PERSONALIZED MEDICINE, 2023, 13 (12):
  • [8] Automatic Extraction of Skeletal Maturity from Whole Body Pediatric Scoliosis X-rays Using Regional Proposal and Compound Scaling Convolutional Neural Networks
    Ha, Audrey
    Vorhies, John
    Campion, Andrew
    Fang, Charles
    Fadell, Michael, II
    Dou, Steve
    Halabi, Safwan
    Larson, David
    Wang, Emily
    Lee, YongJin
    Langner, Joanna
    Kaur, Japsimran
    Do, Bao
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 996 - 1000