TinyCheXReport: Compressed Deep Neural Network for Chest X-ray Report Generation

被引:0
|
作者
Alotaibi, Fahd Saleh [1 ]
Hamed, Khaled [1 ]
Mittal, Ajay [2 ]
Gupta, Vishal [2 ]
Kaur, Navdeep [3 ]
机构
[1] King Abdulaziz Univ, Jeddah, Makkah, Saudi Arabia
[2] Panjab Univ, Chandigarh, Punjab, India
[3] Mehr Chand Mahajan DAV Coll Women, Comp Sci & Applicat, Chandigarh, India
关键词
Pruning; compressed deep neural network; radiology report;
D O I
10.1145/3676166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Increase in Chest X-ray (CXR) imaging tests has burdened radiologists, thereby posing significant challenges in writing radiological reports on time. Although several deep learning-based automatic report generation methods have been developed, most are over-parameterized. For deployment on edge devices with constrained processing power or limited resources, over-parameterized models are often too large. This article presents a compressed deep learning-based model that is 30% space efficient compared to the non-compressed base model, while both have comparable performance. The model comprising VGG19 and hierarchical long short-term memory equipped with a contextual word embedding layer is used as the base model. The redundant weight parameters are removed from the base model using unstructured one-shot pruning. To overcome the performance degradation, the lightweight pruned model is fine-tuned over publicly available OpenI dataset. The quantitative evaluation metric scores demonstrate that proposed model surpasses the performance of state-of-the-art models. Additionally, the proposed model, being 30% space efficient, is easily deployable in resource-limited settings. Thus, this study serves as baseline for development of compressed models to generate radiological reports from CXR images.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] An Automated Lightweight Deep Neural Network for Diagnosis of COVID-19 from Chest X-ray Images
    Nayak, Soumya Ranjan
    Nayak, Janmenjoy
    Sinha, Utkarsh
    Arora, Vaibhav
    Ghosh, Uttam
    Satapathy, Suresh Chandra
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2023, 48 (08) : 11085 - 11102
  • [42] Performance Evaluation of the Deep Learning Based Convolutional Neural Network Approach for the Recognition of Chest X-Ray Images
    Sharma, Sandhya
    Gupta, Sheifali
    Gupta, Deepali
    Rashid, Junaid
    Juneja, Sapna
    Kim, Jungeun
    Elarabawy, Mahmoud M.
    FRONTIERS IN ONCOLOGY, 2022, 12
  • [43] Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network
    Asmaa Abbas
    Mohammed M. Abdelsamea
    Mohamed Medhat Gaber
    Applied Intelligence, 2021, 51 : 854 - 864
  • [44] An Automated Lightweight Deep Neural Network for Diagnosis of COVID-19 from Chest X-ray Images
    Soumya Ranjan Nayak
    Janmenjoy Nayak
    Utkarsh Sinha
    Vaibhav Arora
    Uttam Ghosh
    Suresh Chandra Satapathy
    Arabian Journal for Science and Engineering, 2023, 48 : 11085 - 11102
  • [45] Automated COVID-19 detection using Deep Convolutional Neural Network and Chest X-ray Images
    Agrawal, Tarun
    Choudhary, Prakash
    2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL PERFORMANCE EVALUATION (COMPE-2021), 2021, : 277 - 281
  • [46] An Attention-Guided Deep Neural Network for Annotating Abnormalities in Chest X-ray Images: Visualization of Network Decision Basis
    Saednia, Khadijeh
    Jalalifar, Ali
    Ebrahimi, Shahin
    Sadeghi-Naini, Ali
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 1258 - 1261
  • [47] Deep Attention Network for Pneumonia Detection Using Chest X-Ray Images
    Singh, Sukhendra
    Rawat, Sur Singh
    Gupta, Manoj
    Tripathi, B. K.
    Alanzi, Faisal
    Majumdar, Arnab
    Khuwuthyakorn, Pattaraporn
    Thinnukool, Orawit
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (01): : 1673 - 1691
  • [48] Determination of Pneumonia in X-ray Chest Images by Using Convolutional Neural Network
    Polat, Ozlem
    Dokur, Zumray
    Olmez, Tamer
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2021, 29 (03) : 1615 - 1627
  • [49] Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generation
    Li, Mingjie
    Lin, Bingqian
    Chen, Zicong
    Lin, Haokun
    Liang, Xiaodan
    Chang, Xiaojun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3334 - 3343
  • [50] Deep neural network for x-ray photoelectron spectroscopy data analysis
    Drera, G.
    Kropf, C. M.
    Sangaletti, L.
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2020, 1 (01):