NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:36
|
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [41] An end-to-end implicit neural representation architecture for medical volume data
    Sheibanifard, Armin
    Yu, Hongchuan
    Ruan, Zongcai
    Zhang, Jian J.
    PLOS ONE, 2025, 20 (01):
  • [42] Iterative reconstruction for limited-angle CT using implicit neural representation
    Lee, Jooho
    Baek, Jongduk
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (10):
  • [43] Three-Dimensional Reconstruction of Indoor Scenes Based on Implicit Neural Representation
    Lin, Zhaoji
    Huang, Yutao
    Yao, Li
    JOURNAL OF IMAGING, 2024, 10 (09)
  • [44] A realistic simulation framework for assessing deformable slice-to-volume (CT-fluoroscopy/CT) registration
    Yaniv, Ziv
    Stenzel, Roland
    Cleary, Kevin
    Banovac, Filip
    MEDICAL IMAGING 2006: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND DISPLAY, 2006, 6141
  • [45] Volume Reconstruction for MRI
    Zhang, Meiqing
    Nie, Huirao
    Pei, Yang
    Tao, Linmi
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 3351 - 3356
  • [46] Editorial for "Retrospective Distortion and Motion Correction for Free-Breathing DW-MRI of the Kidneys Using Dual Echo EPI and Slice-to-Volume Registration"
    Muglia, Valdair F.
    Salmon, Carlos Ernesto Garrido
    JOURNAL OF MAGNETIC RESONANCE IMAGING, 2021, 53 (05) : 1444 - 1445
  • [47] Retrospective Distortion and Motion Correction for Free-Breathing DW-MRI of the Kidneys Using Dual-Echo EPI and Slice-to-Volume Registration
    Coll-Font, Jaume
    Afacan, Onur
    Hoge, Scott
    Garg, Harsha
    Shashi, Kumar
    Marami, Bahram
    Gholipour, Ali
    Chow, Jeanne
    Warfield, Simon
    Kurugol, Sila
    JOURNAL OF MAGNETIC RESONANCE IMAGING, 2021, 53 (05) : 1432 - 1443
  • [48] NeRP: Implicit Neural Representation Learning With Prior Embedding for Sparsely Sampled Image Reconstruction
    Shen, Liyue
    Pauly, John
    Xing, Lei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 770 - 782
  • [49] PeINR: Periodic Implicit Neural Representation for Single-view Clothed Human Reconstruction
    Wan, Yan (winniewan@dhu.edu.cn), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [50] An Energy-Efficient Accelerator for Medical Image Reconstruction From Implicit Neural Representation
    Rao, Chaolin
    Wu, Qing
    Zhou, Pingqiang
    Yu, Jingyi
    Zhang, Yuyao
    Lou, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (04) : 1625 - 1638