TinyCheXReport: Compressed Deep Neural Network for Chest X-ray Report Generation

被引:0
|
作者
Alotaibi, Fahd Saleh [1 ]
Hamed, Khaled [1 ]
Mittal, Ajay [2 ]
Gupta, Vishal [2 ]
Kaur, Navdeep [3 ]
机构
[1] King Abdulaziz Univ, Jeddah, Makkah, Saudi Arabia
[2] Panjab Univ, Chandigarh, Punjab, India
[3] Mehr Chand Mahajan DAV Coll Women, Comp Sci & Applicat, Chandigarh, India
关键词
Pruning; compressed deep neural network; radiology report;
D O I
10.1145/3676166
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Increase in Chest X-ray (CXR) imaging tests has burdened radiologists, thereby posing significant challenges in writing radiological reports on time. Although several deep learning-based automatic report generation methods have been developed, most are over-parameterized. For deployment on edge devices with constrained processing power or limited resources, over-parameterized models are often too large. This article presents a compressed deep learning-based model that is 30% space efficient compared to the non-compressed base model, while both have comparable performance. The model comprising VGG19 and hierarchical long short-term memory equipped with a contextual word embedding layer is used as the base model. The redundant weight parameters are removed from the base model using unstructured one-shot pruning. To overcome the performance degradation, the lightweight pruned model is fine-tuned over publicly available OpenI dataset. The quantitative evaluation metric scores demonstrate that proposed model surpasses the performance of state-of-the-art models. Additionally, the proposed model, being 30% space efficient, is easily deployable in resource-limited settings. Thus, this study serves as baseline for development of compressed models to generate radiological reports from CXR images.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Deep learning for report generation on chest X-ray images
    Ouis, Mohammed Yasser
    Akhloufi, Moulay A.
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 111
  • [2] Deep Neural Network for Lung Image Segmentation on Chest X-ray
    Chavan, Mahesh
    Varadarajan, Vijayakumar
    Gite, Shilpa
    Kotecha, Ketan
    TECHNOLOGIES, 2022, 10 (05)
  • [3] Baselines for Chest X-Ray Report Generation
    Boag, William
    Hsu, Tzu-Ming Harry
    McDermott, Matthew
    Berner, Gabriela
    Alsentzer, Emily
    Szolovits, Peter
    MACHINE LEARNING FOR HEALTH WORKSHOP, VOL 116, 2019, 116 : 126 - 140
  • [4] Classification of Chest X-ray Images Using Deep Convolutional Neural Network
    Hao, Ting
    Lu, Tong
    Li, Xia
    2021 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS DASC/PICOM/CBDCOM/CYBERSCITECH 2021, 2021, : 440 - 445
  • [5] Deep Convolutional Neural Network with Segmentation Techniques for Chest X-Ray Analysis
    Wang, Binquan
    Wu, Zeyuan
    Khan, Zakir Ullah
    Liu, Chenglin
    Zhu, Ming
    PROCEEDINGS OF THE 2019 14TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2019), 2019, : 1212 - 1216
  • [6] A Deep Neural Network for Detecting Coronavirus Disease Using Chest X-Ray Images
    Gupta, Rajeev Kumar
    Kunhare, Nilesh
    Pateriya, Rajesh Kumar
    Pathik, Nikhlesh
    INTERNATIONAL JOURNAL OF HEALTHCARE INFORMATION SYSTEMS AND INFORMATICS, 2022, 17 (02) : 1 - 27
  • [7] Chest X-ray image denoising method based on deep convolution neural network
    Jin, Yan
    Jiang, Xiao-Ben
    Wei, Zhen-kun
    Li, Yuan
    IET IMAGE PROCESSING, 2019, 13 (11) : 1970 - 1978
  • [8] Self-Supervised Deep Convolutional Neural Network for Chest X-Ray Classification
    Gazda, Matej
    Plavka, Jan
    Gazda, Jakub
    Drotar, Peter
    IEEE ACCESS, 2021, 9 : 151972 - 151982
  • [9] Diagnosis of Chest Diseases in X-Ray images using Deep Convolutional Neural Network
    Choudhary, Arjun
    Hazra, Abhishek
    Choudhary, Prakash
    2019 10TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2019,
  • [10] Clinically Accurate Chest X-Ray Report Generation
    Liu, Guanxiong
    Hsu, Tzu-Ming Harry
    McDermott, Matthew
    Boag, Willie
    Weng, Wei-Hung
    Szolovits, Peter
    Ghassemi, Marzyeh
    MACHINE LEARNING FOR HEALTHCARE CONFERENCE, VOL 106, 2019, 106