NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:36
|
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [31] Correction of misaligned slices in multi-slice MR cardiac examinations by using slice-to-volume registration
    Chandler, A. G.
    Pinder, R. J.
    Netsch, T.
    Schnabel, J. A.
    Hawkes, D. J.
    Hill, D. L. G.
    Razavi, R.
    2006 3RD IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: MACRO TO NANO, VOLS 1-3, 2006, : 474 - +
  • [32] Correction of misaligned slices in multi-slice cardiovascular magnetic resonance using slice-to-volume registration
    Chandler, Adam G.
    Pinder, Richard J.
    Netsch, Thomas
    Schnabel, Julia A.
    Hawkes, David J.
    Hill, Derek L. G.
    Razavi, Reza
    JOURNAL OF CARDIOVASCULAR MAGNETIC RESONANCE, 2008, 10 (1)
  • [33] Real-time and multimodal brain slice-to-volume registration using CNN
    Chen, Zixuan
    Xu, Zekai
    Yi, Weiwei
    Yang, Xin
    Hou, Wenguang
    Ding, Mingyue
    Granichin, Oleg
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 133 : 86 - 96
  • [34] Spectral-Wise Implicit Neural Representation for Hyperspectral Image Reconstruction
    Chen, Huan
    Zhao, Wangcai
    Xu, Tingfa
    Shi, Guokai
    Zhou, Shiyun
    Liu, Peifu
    Li, Jianan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3714 - 3727
  • [35] Continuous Spatial-Spectral Reconstruction via Implicit Neural Representation
    Xu, Ruikang
    Yao, Mingde
    Chen, Chang
    Wang, Lizhi
    Xiong, Zhiwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (01) : 106 - 128
  • [36] Efficient neural implicit representation for 3D human reconstruction
    Huang, Zexu
    Erfani, Sarah Monazam
    Lu, Siying
    Gong, Mingming
    PATTERN RECOGNITION, 2024, 156
  • [37] MISNeR: Medical Implicit Shape Neural Representation for Image Volume Visualisation
    Jin, G.
    Jung, Y.
    Bi, L.
    Kim, J.
    COMPUTER GRAPHICS FORUM, 2024, 43 (07)
  • [38] Slice-to-volume registration using mutual information between probabilistic image classifications
    Chandler, AG
    Netsch, T
    Cocosco, CA
    Schnabel, JA
    Hawkes, DJ
    MEDICAL IMAGING 2004: IMAGE PROCESSING, PTS 1-3, 2004, 5370 : 1120 - 1129
  • [39] Motion correction in fMRI by mapping slice-to-volume with concurrent field-inhomogeneity correction
    Yeo, DTB
    Fessler, JA
    Kim, B
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2004, PT 2, PROCEEDINGS, 2004, 3217 : 752 - 760
  • [40] Slice-to-volume registration and its potential application to interventional MRI-guided radio-frequency thermal ablation of prostate cancer
    Fei, BW
    Duerk, JL
    Boll, DT
    Lewin, JS
    Wilson, DL
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2003, 22 (04) : 515 - 525