Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation

被引:18
|
作者
Evain, Ewan [1 ,2 ]
Sun, Yunyun [1 ]
Faraz, Khuram [1 ]
Garcia, Damien [1 ]
Saloux, Eric [3 ]
Gerber, Bernhard L. [4 ]
De Craene, Mathieu [2 ]
Bernard, Olivier [1 ]
机构
[1] Univ 1 Lyon, Inserm U1294, CNRS UMR5220, CREATIS,INSA Lyon, F-69621 Villeurbanne, France
[2] Philips Res Paris Medisys, F-92156 Suresnes, France
[3] Normandie Univ, Dept Cardiol, UNICAEN, CHU Caen Normandie,EA4650 SEILIRM, F-14000 Caen, France
[4] Clin Univ St Luc UCL, B-1200 Brussels, Belgium
关键词
Ultrasonic imaging; Myocardium; Motion estimation; Strain; Imaging; Speckle; Reverberation; Deep learning; echocardiography; motion estimation; ultrasound imaging;
D O I
10.1109/TMI.2022.3151606
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motion estimation in echocardiography plays an important role in the characterization of cardiac function, allowing the computation of myocardial deformation indices. However, there exist limitations in clinical practice, particularly with regard to the accuracy and robustness of measurements extracted from images. We therefore propose a novel deep learning solution for motion estimation in echocardiography. Our network corresponds to a modified version of PWC-Net which achieves high performance on ultrasound sequences. In parallel, we designed a novel simulation pipeline allowing the generation of a large amount of realistic B-mode sequences. These synthetic data, together with strategies during training and inference, were used to improve the performance of our deep learning solution, which achieved an average endpoint error of 0.07 +/- 0.06 mm per frame and 1.20 +/- 0.67 mm between ED and ES on our simulated dataset. The performance of our method was further investigated on 30 patients from a publicly available clinical dataset acquired from a GE system. The method showed promise by achieving a mean absolute error of the global longitudinal strain of 2.5 +/- 2.1% and a correlation of 0.77 compared to GLS derived from manual segmentation, much better than one of the most efficient methods in the state-of-the-art (namely the FFT-Xcorr block-matching method). We finally evaluated our method on an auxiliary dataset including 30 patients from another center and acquired with a different system. Comparable results were achieved, illustrating the ability of our method to maintain high performance regardless of the echocardiographic data processed.
引用
收藏
页码:1911 / 1924
页数:14
相关论文
共 50 条
  • [21] A Survey on Deep Learning-Based 2D Human Pose Estimation Models
    Salisu S.
    Mohamed A.S.A.
    Jaafar M.H.
    Pauzi A.S.B.
    Younis H.A.
    Computers, Materials and Continua, 2023, 76 (02): : 2385 - 2400
  • [22] Quick Estimation of Cutout Factor in 2D Electron Radiotherapy Using Deep Learning
    Kazemifar, S.
    Owrangi, A.
    Lin, M.
    Jiang, S.
    Park, Y.
    MEDICAL PHYSICS, 2020, 47 (06) : E839 - E839
  • [23] A Survey on Deep Learning-Based 2D Human Pose Estimation Models
    Salisu, Sani
    Mohamed, A. S. A.
    Jaafar, M. H.
    Pauzi, Ainun S. B.
    Younis, Hussain A.
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (02): : 2385 - 2400
  • [24] 3D Human Pose Estimation via Deep Learning from 2D annotations
    Brau, Ernesto
    Jiang, Hao
    PROCEEDINGS OF 2016 FOURTH INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2016, : 582 - 591
  • [25] 2D/3D Pose Estimation and Action Recognition using Multitask Deep Learning
    Luvizon, Diogo C.
    Picard, David
    Tabia, Hedi
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 5137 - 5146
  • [26] Automated assembly quality inspection by deep learning with 2D and 3D synthetic CAD data
    Zhu, Xiaomeng
    Martensson, Par
    Hanson, Lars
    Bjorkman, Marten
    Maki, Atsuto
    JOURNAL OF INTELLIGENT MANUFACTURING, 2024, 36 (4) : 2567 - 2582
  • [27] Learning Character-Agnostic Motion for Motion Retargeting in 2D
    Aberman, Kfir
    Wu, Rundi
    Lischinski, Dani
    Chen, Baoquan
    Cohen-Or, Daniel
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04):
  • [28] 3DCD: A NEW DATASET FOR 2D AND 3D CHANGE DETECTION USING DEEP LEARNING TECHNIQUES
    Coletta, V
    Marsocci, V
    Ravanelli, R.
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 1349 - 1354
  • [29] 2D geometric shapes dataset - for machine learning and pattern recognition
    El Korchi, Anas
    Ghanou, Youssef
    DATA IN BRIEF, 2020, 32
  • [30] A mathematical model for the 3d location estimation of 2D echocardiography data
    Ahn, Chi Young
    Yun, Sangwoon
    APPLIED MATHEMATICS LETTERS, 2019, 88 : 186 - 192