Fully automated 2D and 3D convolutional neural networks pipeline for video segmentation and myocardial infarction detection in echocardiography

被引:0
|
作者
Oumaima Hamila
Sheela Ramanna
Christopher J. Henry
Serkan Kiranyaz
Ridha Hamila
Rashid Mazhar
Tahir Hamid
机构
[1] The University of Winnipeg,Department of Applied Computer Science
[2] Qatar University,Department of Electrical Engineering
[3] Thoracic Surgery,undefined
[4] Hamad Hospital,undefined
[5] Hamad Medical Corporation,undefined
[6] Cardiology,undefined
[7] Heart Hospital Hamad Medical Corporation,undefined
来源
Multimedia Tools and Applications | 2022年 / 81卷
关键词
3D convolutional neural network; Video segmentation; Myocardial infarction; Detection; Echocardiography;
D O I
暂无
中图分类号
学科分类号
摘要
Myocardial infarction (MI) is a life-threatening disorder that occurs due to a prolonged limitation of blood supply to the heart muscles, and which requires an immediate diagnosis to prevent death. To detect MI, cardiologists utilize in particular echocardiography, which is a non-invasive cardiac imaging that generates real-time visualization of the heart chambers and the motion of the heart walls. These videos enable cardiologists to identify almost immediately regional wall motion abnormalities (RWMA) of the left ventricle (LV) chamber, which are highly correlated with MI. However, data acquisition is usually performed during emergency which results in poor-quality and noisy data that can affect the accuracy of the diagnosis. To address the identified problems, we propose in this paper an innovative, real-time and fully automated model based on convolutional neural networks (CNN) to early detect MI in a patient’s echocardiography. Our model is a pipeline consisting of a 2D CNN that performs data preprocessing by segmenting the LV chamber from the apical four-chamber (A4C) view, followed by a 3D CNN that performs a binary classification to detect MI. The pipeline was trained and tested on the HMC-QU dataset consisting of 162 echocardiography. The 2D CNN achieved 97.18% accuracy on data segmentation, and the 3D CNN achieved 90.9% accuracy, 100% precision, 95% recall, and 97.2% F1 score. Our detection results outperformed existing state-of-the-art models that were tested on the HMC-QU dataset for MI detection. This work demonstrates that developing a fully automated system for LV segmentation and MI detection is efficient and propitious.
引用
收藏
页码:37417 / 37439
页数:22
相关论文
共 50 条
  • [21] 3D VIDEO SUPER-RESOLUTION USING FULLY CONVOLUTIONAL NEURAL NETWORKS
    Xie, Yanchun
    Xiao, Jimin
    Tillo, Tammam
    Wei, Yunchao
    Zhao, Yao
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2016,
  • [22] 3D convolutional neural networks for tumor segmentation using long-range 2D context
    Mlynarski, Pawel
    Delingette, Herve
    Criminisi, Antonio
    Ayache, Nicholas
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2019, 73 : 60 - 72
  • [23] A Hybrid Neuroevolutionary Approach to the Design of Convolutional Neural Networks for 2D and 3D Medical Image Segmentation
    Ramesh, Nivedha
    Ashfaq, Tabish
    Kharma, Nawwaf
    ARTIFICIAL NEURAL NETWORKS IN PATTERN RECOGNITION, ANNPR 2024, 2024, 15154 : 87 - 98
  • [24] An Ensemble of 2D Convolutional Neural Network for 3D Brain Tumor Segmentation
    Pawar, Kamlesh
    Chen, Zhaolin
    Shah, N. Jon
    Egan, Gary F.
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES (BRAINLES 2019), PT I, 2020, 11992 : 359 - 367
  • [25] Fully automated longitudinal segmentation of new or enlarged multiple sclerosis lesions using 3D convolutional neural networks
    Krueger, Julia
    Opfer, Roland
    Gessert, Nils
    Ostwaldt, Ann-Christin
    Manogaran, Praveena
    Kitzler, Hagen H.
    Schlaefer, Alexander
    Schippling, Sven
    NEUROIMAGE-CLINICAL, 2020, 28
  • [26] Automatic Multi-structural Cardiac Segmentation of 2d Echocardiography With Convolutional Neural Networks
    Zhang, Xiaoyan
    Stough, Joshua V.
    Raghunath, Sushravya M.
    Cerna, Alvaro Ulloa
    Vanmaanen, David
    Fornwalt, Brandon
    Haggerty, Christopher M.
    CIRCULATION, 2020, 142
  • [27] Smoke Detection on Video Sequences Using 3D Convolutional Neural Networks
    Lin, Gaohua
    Zhang, Yongming
    Xu, Gao
    Zhang, Qixing
    FIRE TECHNOLOGY, 2019, 55 (05) : 1827 - 1847
  • [28] Smoke Detection on Video Sequences Using 3D Convolutional Neural Networks
    Gaohua Lin
    Yongming Zhang
    Gao Xu
    Qixing Zhang
    Fire Technology, 2019, 55 : 1827 - 1847
  • [29] Detection of Cardiac Events in Echocardiography using 3D Convolutional Recurrent Neural Networks
    Fiorito, Adrian Meidell
    Ostvik, Andreas
    Smistad, Erik
    Leclerc, Sarah
    Bernard, Olivier
    Lovstakken, Lasse
    2018 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2018,
  • [30] 3D Convolutional Neural Networks Initialized from Pretrained 2D Convolutional Neural Networks for Classification of Industrial Parts
    Merino, Ibon
    Azpiazu, Jon
    Remazeilles, Anthony
    Sierra, Basilio
    SENSORS, 2021, 21 (04) : 1 - 18