Deformation-Compensated Learning for Image Reconstruction Without Ground Truth

被引:5
|
作者
Gan, Weijie [1 ]
Sun, Yu [1 ]
Eldeniz, Cihat [2 ]
Liu, Jiaming [3 ]
An, Hongyu [4 ,5 ]
Kamilov, Ulugbek S. [6 ]
机构
[1] Washington Univ, Dept Comp Sci & Engn, St Louis, MO 63130 USA
[2] Washington Univ, Mallinckrodt Inst Radiol, St Louis, MO 63130 USA
[3] Washington Univ, Dept Elect & Syst Engn, St Louis, MO 63130 USA
[4] Mallinckrodt Inst Radiol, Dept Biomed Engn, Dept Neurol, St Louis, MO 63130 USA
[5] Washington Univ, Div Biol & Biomed Sci, St Louis, MO 63130 USA
[6] Washington Univ, Dept Comp Sci & Engn & Elect & Syst Engn, St Louis, MO 63130 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
Training; Magnetic resonance imaging; Noise measurement; Image reconstruction; Strain; Imaging; Convolutional neural networks; Inverse problems; image reconstruction; deep learning; magnetic resonance imaging (MRI); CONVOLUTIONAL NEURAL-NETWORKS; INVERSE PROBLEMS; SPARSE; MOTION; MRI; COMBINATION; FRAMEWORK;
D O I
10.1109/TMI.2022.3163018
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep neural networks for medical image reconstruction are traditionally trained using high-quality ground-truth images as training targets. Recent work on Noise2Noise (N2N) has shown the potential of using multiple noisy measurements of the same object as an alternative to having a ground-truth. However, existing N2N-based methods are not suitable for learning from the measurements of an object undergoing nonrigid deformation. This paper addresses this issue by proposing the deformation-compensated learning (DeCoLearn) method for training deep reconstruction networks by compensating for object deformations. A key component of DeCoLearn is a deep registration module, which is jointly trained with the deep reconstruction network without any ground-truth supervision. We validate DeCoLearn on both simulated and experimentally collected magnetic resonance imaging (MRI) data and show that it significantly improves imaging quality.
引用
收藏
页码:2371 / 2384
页数:14
相关论文
共 50 条
  • [1] LEARNING NONPARAMETRIC HUMAN MESH RECONSTRUCTION FROM A SINGLE IMAGE WITHOUT GROUND TRUTH MESHES
    Lin, Kevin
    Wang, Lijuan
    Jin, Ying
    Liu, Zicheng
    Sun, Ming-Ting
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 964 - 968
  • [2] Deformation-compensated averaging for clutter reduction in epiphotoacoustic imaging in vivo
    Jaeger, Michael
    Harris-Birtill, David
    Gertsch, Andreas
    O'Flynn, Elizabeth
    Bamber, Jeffrey
    [J]. JOURNAL OF BIOMEDICAL OPTICS, 2012, 17 (06)
  • [3] Reducing magnetic resonance image spacing by learning without ground-truth
    Xuan, Kai
    Si, Liping
    Zhang, Lichi
    Xue, Zhong
    Jiao, Yining
    Yao, Weiwu
    Shen, Dinggang
    Wu, Dijia
    Wang, Qian
    [J]. PATTERN RECOGNITION, 2021, 120
  • [4] Training Image Estimators without Image Ground-Truth
    Xia, Zhihao
    Chakrabarti, Ayan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [5] Training deep learning based image denoisers from undersampled measurements without ground truth and without image prior
    Zhussip, Magauiya
    Soltanayev, Shakarim
    Chun, Se Young
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10247 - 10256
  • [6] Learning the probability of correspondences without ground truth
    Yang, QX
    Steele, RM
    Nistér, D
    Jaynes, C
    [J]. TENTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1 AND 2, PROCEEDINGS, 2005, : 1140 - 1147
  • [7] Active learning of the ground truth for retinal image segmentation
    Nedoshivina, L.
    Lensu, L.
    [J]. JOURNAL OF OPTICAL TECHNOLOGY, 2019, 86 (11) : 697 - 703
  • [8] Comparison of algorithms for ultrasound image segmentation without ground truth
    Sikka, Karan
    Deserno, Thomas M.
    [J]. MEDICAL IMAGING 2010: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2010, 7627
  • [9] Bootstrap Resampling for Image Registration Uncertainty Estimation Without Ground Truth
    Kybic, Jan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (01) : 64 - 73
  • [10] Image registration accuracy estimation without ground truth using bootstrap
    Kybic, Jan
    Smutek, Daniel
    [J]. COMPUTER VISION APPROACHES TO MEDICAL IMAGE ANALYSIS, 2006, 4241 : 61 - 72