TinyCheXReport: Compressed Deep Neural Network for Chest X-ray Report Generation

被引:0
|
作者
Alotaibi, Fahd Saleh [1 ]
Hamed, Khaled [1 ]
Mittal, Ajay [2 ]
Gupta, Vishal [2 ]
Kaur, Navdeep [3 ]
机构
[1] King Abdulaziz Univ, Jeddah, Makkah, Saudi Arabia
[2] Panjab Univ, Chandigarh, Punjab, India
[3] Mehr Chand Mahajan DAV Coll Women, Comp Sci & Applicat, Chandigarh, India
关键词
Pruning; compressed deep neural network; radiology report;
D O I
10.1145/3676166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Increase in Chest X-ray (CXR) imaging tests has burdened radiologists, thereby posing significant challenges in writing radiological reports on time. Although several deep learning-based automatic report generation methods have been developed, most are over-parameterized. For deployment on edge devices with constrained processing power or limited resources, over-parameterized models are often too large. This article presents a compressed deep learning-based model that is 30% space efficient compared to the non-compressed base model, while both have comparable performance. The model comprising VGG19 and hierarchical long short-term memory equipped with a contextual word embedding layer is used as the base model. The redundant weight parameters are removed from the base model using unstructured one-shot pruning. To overcome the performance degradation, the lightweight pruned model is fine-tuned over publicly available OpenI dataset. The quantitative evaluation metric scores demonstrate that proposed model surpasses the performance of state-of-the-art models. Additionally, the proposed model, being 30% space efficient, is easily deployable in resource-limited settings. Thus, this study serves as baseline for development of compressed models to generate radiological reports from CXR images.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection Using Chest X-ray
    Rahman, Tawsifur
    Chowdhury, Muhammad E. H.
    Khandakar, Amith
    Islam, Khandaker R.
    Islam, Khandaker F.
    Mahbub, Zaid B.
    Kadir, Muhammad A.
    Kashem, Saad
    APPLIED SCIENCES-BASEL, 2020, 10 (09):
  • [22] An Improved Densenet Deep Neural Network Model for Tuberculosis Detection Using Chest X-Ray Images
    Huy, Vo Trong Quang
    Lin, Chih-Min
    IEEE ACCESS, 2023, 11 : 42839 - 42849
  • [23] Lightweight convolutional neural network for chest X-ray images classification
    Yen, Chih-Ta
    Tsao, Chia-Yu
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [24] Using Convolutional Neural Network for Chest X-ray Image classification
    Soric, Matija
    Pongrac, Danijela
    Inza, Inaki
    2020 43RD INTERNATIONAL CONVENTION ON INFORMATION, COMMUNICATION AND ELECTRONIC TECHNOLOGY (MIPRO 2020), 2020, : 1771 - 1776
  • [25] Improving Chest X-Ray Report Generation by Leveraging Warm Starting
    Nicolson, Aaron
    Dowling, Jason
    Koopman, Bevan
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2023, 144
  • [26] Controllable Chest X-Ray Report Generation from Longitudinal Representations
    Serra, Francesco Dalla
    Wang, Chaoyang
    Deligianni, Fani
    Dalton, Jeffrey
    O'Neil, Alison Q.
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 4891 - 4904
  • [27] Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation
    Yan, An
    He, Zexue
    Lu, Xing
    Du, Jiang
    Chang, Eric
    Gentili, Amilcare
    McAuley, Julian
    Hsu, Chun-Nan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 4009 - 4015
  • [28] Evaluating progress in automatic chest X-ray radiology report generation
    Yu, Feiyang
    Endo, Mark
    Krishnan, Rayan
    Pan, Ian
    Tsai, Andy
    Reis, Eduardo Pontes
    Fonseca, Eduardo Kaiser Ururahy Nunes
    Lee, Henrique Min Ho
    Abad, Zahra Shakeri Hossein
    Ng, Andrew Y.
    Langlotz, Curtis P.
    Venugopal, Vasantha Kumar
    Rajpurkar, Pranav
    PATTERNS, 2023, 4 (09):
  • [29] Detection of anatomical structures in chest X-ray photographs by deep neural networks
    Kondo K.
    Ozawa J.
    Kiyono M.
    Fujimoto S.
    Tanaka M.
    Adachi T.
    Ito H.
    Kimura H.
    2018, Japan Soc. of Med. Electronics and Biol. Engineering (56): : 243 - 251
  • [30] Synthesizing Chest X-Ray Pathology for Training Deep Convolutional Neural Networks
    Salehinejad, Hojjat
    Colak, Errol
    Dowdell, Tim
    Barfett, Joseph
    Valaee, Shahrokh
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (05) : 1197 - 1206