Motion Estimation by Deep Learning in 2D Echocardiography: Synthetic Dataset and Validation

被引:18
|
作者
Evain, Ewan [1 ,2 ]
Sun, Yunyun [1 ]
Faraz, Khuram [1 ]
Garcia, Damien [1 ]
Saloux, Eric [3 ]
Gerber, Bernhard L. [4 ]
De Craene, Mathieu [2 ]
Bernard, Olivier [1 ]
机构
[1] Univ 1 Lyon, Inserm U1294, CNRS UMR5220, CREATIS,INSA Lyon, F-69621 Villeurbanne, France
[2] Philips Res Paris Medisys, F-92156 Suresnes, France
[3] Normandie Univ, Dept Cardiol, UNICAEN, CHU Caen Normandie,EA4650 SEILIRM, F-14000 Caen, France
[4] Clin Univ St Luc UCL, B-1200 Brussels, Belgium
关键词
Ultrasonic imaging; Myocardium; Motion estimation; Strain; Imaging; Speckle; Reverberation; Deep learning; echocardiography; motion estimation; ultrasound imaging;
D O I
10.1109/TMI.2022.3151606
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motion estimation in echocardiography plays an important role in the characterization of cardiac function, allowing the computation of myocardial deformation indices. However, there exist limitations in clinical practice, particularly with regard to the accuracy and robustness of measurements extracted from images. We therefore propose a novel deep learning solution for motion estimation in echocardiography. Our network corresponds to a modified version of PWC-Net which achieves high performance on ultrasound sequences. In parallel, we designed a novel simulation pipeline allowing the generation of a large amount of realistic B-mode sequences. These synthetic data, together with strategies during training and inference, were used to improve the performance of our deep learning solution, which achieved an average endpoint error of 0.07 +/- 0.06 mm per frame and 1.20 +/- 0.67 mm between ED and ES on our simulated dataset. The performance of our method was further investigated on 30 patients from a publicly available clinical dataset acquired from a GE system. The method showed promise by achieving a mean absolute error of the global longitudinal strain of 2.5 +/- 2.1% and a correlation of 0.77 compared to GLS derived from manual segmentation, much better than one of the most efficient methods in the state-of-the-art (namely the FFT-Xcorr block-matching method). We finally evaluated our method on an auxiliary dataset including 30 patients from another center and acquired with a different system. Comparable results were achieved, illustrating the ability of our method to maintain high performance regardless of the echocardiographic data processed.
引用
收藏
页码:1911 / 1924
页数:14
相关论文
共 50 条
  • [1] A deep learning phase-based solution in 2D echocardiography motion estimation
    Khoubani, Sahar
    Moradi, Mohammad Hassan
    PHYSICAL AND ENGINEERING SCIENCES IN MEDICINE, 2024, 47 (04) : 1691 - 1703
  • [2] Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography
    Leclerc, Sarah
    Smistad, Erik
    Pedrosa, Joao
    Ostvik, Andreas
    Cervenansky, Frederic
    Espinosa, Florian
    Espeland, Torvald
    Berg, Erik Andreas Rye
    Jodoin, Pierre-Marc
    Grenier, Thomas
    Lartizien, Carole
    D'hooge, Jan
    Lovstakken, Lasse
    Bernard, Olivier
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (09) : 2198 - 2210
  • [3] Generalizability and quality control of deep learning-based 2D echocardiography segmentation models in a large clinical dataset
    Xiaoyan Zhang
    Alvaro E. Ulloa Cerna
    Joshua V. Stough
    Yida Chen
    Brendan J. Carry
    Amro Alsaid
    Sushravya Raghunath
    David P. vanMaanen
    Brandon K. Fornwalt
    Christopher M. Haggerty
    The International Journal of Cardiovascular Imaging, 2022, 38 : 1685 - 1697
  • [4] Generalizability and quality control of deep learning-based 2D echocardiography segmentation models in a large clinical dataset
    Zhang, Xiaoyan
    Cerna, Alvaro E. Ulloa
    Stough, Joshua, V
    Chen, Yida
    Carry, Brendan J.
    Alsaid, Amro
    Raghunath, Sushravya
    VanMaanen, David P.
    Fornwalt, Brandon K.
    Haggerty, Christopher M.
    INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING, 2022, 38 (08): : 1685 - 1697
  • [5] Segmentation of Left Ventricle in 2D Echocardiography Using Deep Learning
    Azarmehr, Neda
    Ye, Xujiong
    Sacchi, Stefania
    Howard, James P.
    Francis, Darrel P.
    Zolgharni, Massoud
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, MIUA 2019, 2020, 1065 : 497 - 504
  • [6] Head Motion Classification with 2D Motion Estimation
    Baytas, Inci M.
    Gunsel, Bilge
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 325 - 328
  • [7] Deep Learning Based 2D Human Pose Estimation:A Survey
    Qi Dang
    Jianqin Yin
    Bin Wang
    Wenqing Zheng
    Tsinghua Science and Technology, 2019, 24 (06) : 663 - 676
  • [8] Overview on 2D Human Pose Estimation Based on Deep Learning
    Zhang Y.
    Wen G.-Z.
    Mi S.-Y.
    Zhang M.-L.
    Geng X.
    Ruan Jian Xue Bao/Journal of Software, 2022, 33 (11): : 4173 - 4191
  • [9] Deep Learning Based 2D Human Pose Estimation: A Survey
    Dang, Qi
    Yin, Jianqin
    Wang, Bin
    Zheng, Wenqing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2019, 24 (06) : 663 - 676
  • [10] Deep learning–driven permeability estimation from 2D images
    Mauricio Araya-Polo
    Faruk O. Alpak
    Sander Hunter
    Ronny Hofmann
    Nishank Saxena
    Computational Geosciences, 2020, 24 : 571 - 580