NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:36
|
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [21] A comparative study on manual and automatic slice-to-volume registration of CT images
    Fruehwald, Laura
    Kettenbach, Joachim
    Figl, Michael
    Hummel, Johann
    Bergmann, Helmar
    Birkfellner, Wolfgang
    EUROPEAN RADIOLOGY, 2009, 19 (11) : 2647 - 2653
  • [22] Point-Spread-Function-Aware Slice-to-Volume Registration: Application to Upper Abdominal MRI Super-Resolution
    Ebner, Michael
    Chouhan, Manil
    Patel, Premal A.
    Atkinson, David
    Amin, Zahir
    Read, Samantha
    Punwani, Shonit
    Taylor, Stuart
    Vercauteren, Tom
    Ourselin, Sebastien
    RECONSTRUCTION, SEGMENTATION, AND ANALYSIS OF MEDICAL IMAGES, 2017, 10129 : 3 - 13
  • [23] Stochastic rank correlation for slice-to-volume registration of fluoroCT/CT imaging
    Birkfellner, Wolfgang
    Figl, Michael
    Bergmann, Helmar
    MEDICAL IMAGING 2007: VISUALIZATION AND IMAGE-GUIDED PROCEDURES, PTS 1 AND 2, 2007, 6509
  • [24] Self-learning based medical image representation for rigid real-time and multimodal slice-to-volume registration
    Chen, Zixuan
    Xu, Zekai
    Gui, Qiuling
    Yang, Xin
    Cheng, Qimin
    Hou, Wenguang
    Ding, Mingyue
    INFORMATION SCIENCES, 2020, 541 : 502 - 515
  • [25] Learning Implicit Neural Representation for Satellite Object Mesh Reconstruction
    Yang, Xi
    Cao, Mengqing
    Li, Cong
    Zhao, Hua
    Yang, Dong
    REMOTE SENSING, 2023, 15 (17)
  • [26] A comparative study on manual and automatic slice-to-volume registration of CT images
    Laura Frühwald
    Joachim Kettenbach
    Michael Figl
    Johann Hummel
    Helmar Bergmann
    Wolfgang Birkfellner
    European Radiology, 2009, 19 : 2647 - 2653
  • [27] Correction of misaligned slices in multi-slice cardiovascular magnetic resonance using slice-to-volume registration
    Adam G Chandler
    Richard J Pinder
    Thomas Netsch
    Julia A Schnabel
    David J Hawkes
    Derek LG Hill
    Reza Razavi
    Journal of Cardiovascular Magnetic Resonance, 10
  • [28] Rigid Slice-To-Volume Medical Image Registration Through Markov Random Fields
    Porchetto, Roque
    Stramana, Franco
    Paragios, Nikos
    Ferrante, Enzo
    MEDICAL COMPUTER VISION AND BAYESIAN AND GRAPHICAL MODELS FOR BIOMEDICAL IMAGING, 2017, 10081 : 172 - 185
  • [29] HIVE: HIerarchical Volume Encoding for Neural Implicit Surface Reconstruction
    Gu, Xiaodong
    Yuan, Weihao
    Li, Heng
    Dong, Zilong
    Tan, Ping
    arXiv,
  • [30] 基于MRI Slice-to-Volume 配准的无辐射颞颌关节动态运动追踪方法
    蒋子昂
    王中正
    蔡宗远
    医用生物力学, 2021, (S1) : 102 - 102