NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:36
|
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [1] Fully Convolutional Slice-to-Volume Reconstruction for Single-Stack MRI
    Young, Sean, I
    Balbastre, Yael
    Fischl, Bruce
    Golland, Polina
    Iglesias, Juan Eugenio
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 11535 - 11545
  • [2] Deformable Slice-to-Volume Registration for Reconstruction of Quantitative T2*Placental and Fetal MRI
    Uus, Alena
    Steinweg, Johannes K.
    Ho, Alison
    Jackson, Laurence H.
    Hajnal, Joseph V.
    Rutherford, Mary A.
    Deprez, Maria
    Hutter, Jana
    MEDICAL ULTRASOUND, AND PRETERM, PERINATAL AND PAEDIATRIC IMAGE ANALYSIS, ASMUS 2020, PIPPI 2020, 2020, 12437 : 222 - 232
  • [3] Prenatal MRI visualisation of the aortic arch and fetal vasculature using motion-corrected slice-to-volume reconstruction
    David Lloyd
    Bernhard Kainz
    Joshua F van Amerom
    Maelene Lohezic
    Kuberan Pushparajah
    John M Simpson
    Christina Malamateniou
    Joseph V Hajnal
    Mary Rutherford
    Reza Razavi
    Journal of Cardiovascular Magnetic Resonance, 18 (Suppl 1)
  • [4] SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI
    Xu, Junshen
    Moyer, Daniel
    Grant, P. Ellen
    Golland, Polina
    Iglesias, Juan Eugenio
    Adalsteinsson, Elfar
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 3 - 13
  • [5] Slice-to-Volume Registration Enables Automated Pancreas MRI Quantification in UK Biobank
    Bagur, Alexandre Triay
    Aljabar, Paul
    Arya, Zobair
    McGonigle, John
    Brady, Sir Michael
    Bulte, Daniel
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS (MIUA 2021), 2021, 12722 : 210 - 223
  • [6] Slice-to-Volume Image Registration Models for MRI-Guided Cardiac Procedures
    Ma, L. W. Lorraine
    Ebrahimi, Mehran
    FUNCTIONAL IMAGING AND MODELLING OF THE HEART, 2017, 10263 : 139 - 151
  • [7] PARTICLE FILTERING FOR SLICE-TO-VOLUME MOTION CORRECTION IN EPI BASED FUNCTIONAL MRI
    Chen, Yu-Hui
    Mittelman, Roni
    Kim, Boklye
    Meyer, Charles
    Hero, Alfred
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 679 - 683
  • [8] Deformable Slice-to-Volume Registration for Motion Correction of Fetal Body and Placenta MRI
    Uus, Alena
    Zhang, Tong
    Jackson, Laurence H.
    Roberts, Thomas A.
    Rutherford, Mary A.
    Hajnal, Joseph, V
    Deprez, Maria
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (09) : 2750 - 2759
  • [9] Spatial attention-based implicit neural representation for arbitrary reduction of MRI slice spacing
    Wang, Xin
    Wang, Sheng
    Xiong, Honglin
    Xuan, Kai
    Zhuang, Zixu
    Liu, Mengjun
    Shen, Zhenrong
    Zhao, Xiangyu
    Zhang, Lichi
    Wang, Qian
    MEDICAL IMAGE ANALYSIS, 2024, 94
  • [10] Graph-Based Slice-to-Volume Deformable Registration
    Ferrante, Enzo
    Paragios, Nikos
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (01) : 36 - 58