Deep learning framework for interpretable quality control of echocardiography video

被引:0
|
作者
Du, Liwei [1 ]
Xue, Wufeng [1 ]
Qi, Zhanru [2 ]
Shi, Zhongqing [2 ]
Guo, Guanjun [2 ]
Yang, Xin [1 ]
Ni, Dong [1 ]
Yao, Jing [2 ,3 ,4 ]
机构
[1] Shenzhen Univ, Med Sch, Sch Biomed Engn, Shenzhen, Peoples R China
[2] Nanjing Univ, Affiliated Hosp, Dept Ultrasound Med, Med Sch, Nanjing, Peoples R China
[3] Nanjing Univ, Affiliated Hosp, Med Imaging Ctr, Med Sch, Nanjing, Peoples R China
[4] Yizheng Hosp, Nanjing Drum Tower Hosp Grp, Yangzhou, Peoples R China
关键词
echocardiography video; multitask network; quality control; real-time; visualized explanation;
D O I
10.1002/mp.17722
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Background: Echocardiography (echo) has become an indispensable tool in modern cardiology, offering real-time imaging that helps clinicians evaluate heart function and identify abnormalities. Despite these advantages, the acquisition of high-quality echo is time-consuming, labor-intensive, and highly subjective. Purpose: The objective of this study is to introduce a comprehensive system for the automated quality control (QC) of echo videos. This system focuses on real-time monitoring of key imaging parameters, reducing the variability associated with manual QC processes. Methods: Our multitask network analyzes cardiac cycle integrity, anatomical structures (AS), depth, cardiac axis angle (CAA), and gain. The network consists of a shared convolutional neural network (CNN) backbone for spatial feature extraction, along with three additional modules: (1) a bidirectional long short-term memory (Bi-LSTM) phase analysis (PA) module for detecting cardiac cycles and QC targets; (2) an oriented object detection head for AS analysis and depth/CAA quantification; and (3) a classification head for gain analysis. The model was trained and tested on a dataset of 1331 echo videos. Through model inference, a comprehensive score is generated, offering easily interpretable insights. Results: The model achieved a mean average precision of 0.962 for AS detection, with PA yielding average frame errors of 1.603 +/-+/- 1.181 (end-diastolic) and 1.681 +/-+/- 1.332 (end-systolic). The gain classification model demonstrated robust performance (Area Under the Curve > 0.98), and the overall processing speed reached 112.4 frames per second. On 203 randomly collected echo videos, the model achieved a kappa coefficient of 0.79 for rating consistency compared to expert evaluations CONCLUSIONS: Given the model's performance on the clinical dataset and its consistency with expert evaluations, our results indicate that the model not only delivers real-time, interpretable quality scores but also demonstrates strong clinical reliability.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Deep Learning Techniques in Video Coding and Quality Analysis
    Topiwala, Pankaj
    Krishnan, Madhu
    Dai, Wei
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLI, 2018, 10752
  • [32] A deep learning approach for quality enhancement of surveillance video
    Ding, Dandan
    Tong, Junchao
    Kong, Lingyi
    JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 24 (03) : 304 - 314
  • [33] Deep Learning for Quality Assessment in Live Video Streaming
    Vega, Maria Torres
    Mocanu, Decebal Constantin
    Famaey, Jeroen
    Stavrou, Stavros
    Liotta, Antonio
    IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (06) : 736 - 740
  • [34] A Deep Learning Framework for Video-Based Vehicle Counting
    Lin, Haojia
    Yuan, Zhilu
    He, Biao
    Kuai, Xi
    Li, Xiaoming
    Guo, Renzhong
    FRONTIERS IN PHYSICS, 2022, 10
  • [35] An explainable and efficient deep learning framework for video anomaly detection
    Chongke Wu
    Sicong Shao
    Cihan Tunc
    Pratik Satam
    Salim Hariri
    Cluster Computing, 2022, 25 : 2715 - 2737
  • [36] Recognition of cursive video text using a deep learning framework
    Mirza, Ali
    Siddiqi, Imran
    IET IMAGE PROCESSING, 2020, 14 (14) : 3444 - 3455
  • [37] An explainable and efficient deep learning framework for video anomaly detection
    Wu, Chongke
    Shao, Sicong
    Tunc, Cihan
    Satam, Pratik
    Hariri, Salim
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (04): : 2715 - 2737
  • [38] Three-Stage Deep Learning Framework for Video Surveillance
    Lee, Ji-Woon
    Kang, Hyun-Soo
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [39] DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics
    Ran, Xukan
    Chen, Haoliang
    Zhu, Xiaodan
    Liu, Zhenming
    Chen, Jiasi
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2018), 2018, : 1421 - 1429
  • [40] Modelling a Deep Learning Framework for Recognition of Human Actions on Video
    Santos, Flavio
    Duraes, Dalila
    Marcondes, Francisco
    Gomes, Marco
    Goncalves, Filipe
    Fonseca, Joaquim
    Wingbermuehle, Jochen
    Machado, Jose
    Novais, Paulo
    TRENDS AND APPLICATIONS IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1, 2021, 1365 : 104 - 112