Energy-Based Prior Latent Space Diffusion Model for Reconstruction of Lumbar Vertebrae from Thick Slice MRI

被引:0
|
作者
Wang, Yanke [1 ,4 ]
Lee, Yolanne Y. R. [2 ]
Dolfini, Aurelio [3 ]
Reischl, Markus [1 ]
Konukoglu, Ender [3 ]
Flouris, Kyriakos [3 ]
机构
[1] Karlsruhe Inst Technol, Hermann Helmholtz Pl 1, D-76344 Eggenstein Leopoldshafen, Germany
[2] UCL, Dept Comp Sci, Gower St, London WC1E 6BT, England
[3] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, ETF E 111,Sternwartstr 7, CH-8092 Zurich, Switzerland
[4] Hong Kong Univ Sci & Technol, Hong Kong Ctr Construct Robot, Units 808 813 & 815,8-F,Bldg 17W,Hong Kong Sci Pk, Hong Kong, Peoples R China
来源
关键词
MRI; Vertebrae; Diffusion models; Energy-based priors; Image reconstruction; ALGORITHM;
D O I
10.1007/978-3-031-72744-3_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Lumbar spine problems are ubiquitous, motivating research into targeted imaging for treatment planning and guided interventions. While high resolution and high contrast CT has been the modality of choice, MRI can capture both bone and soft tissue without the ionizing radiation of CT albeit longer acquisition time. The critical trade-off between contrast quality and acquisition time has motivated 'thick slice MRI', which prioritises faster imaging with high in-plane resolution but variable contrast and low through-plane resolution. We investigate a recently developed post-acquisition pipeline which segments vertebrae from thick-slice acquisitions and uses a variational auto-encoder to enhance quality after an initial 3D reconstruction. We instead propose a latent space diffusion energy-based prior (code for this work is available at https://github.com/Seven-year-promise/LSD_EBM_MRI.) to leverage diffusion models, which exhibit high-quality image generation. Crucially, we mitigate their high computational cost and low sample efficiency by learning an energy-based latent representation to perform the diffusion processes. Our resulting method outperforms existing approaches across metrics including Dice and VS scores, and more faithfully captures 3D features.
引用
收藏
页码:22 / 32
页数:11
相关论文
共 10 条
  • [1] Learning Latent Space Energy-Based Prior Model
    Pang, Bo
    Han, Tian
    Nijkamp, Erik
    Zhu, Song-Chun
    Wu, Ying Nian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] High-Resolution Segmentation of Lumbar Vertebrae from Conventional Thick Slice MRI
    Turella, Federico
    Bredell, Gustav
    Okupnik, Alexander
    Caprara, Sebastiano
    Graf, Dimitri
    Sutter, Reto
    Konukoglu, Ender
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 689 - 698
  • [3] Learning Hierarchical Features with Joint Latent Space Energy-Based Prior
    Cui, Jiali
    Wu, Ying Nian
    Han, Tian
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 2218 - 2227
  • [4] Latent Diffusion Energy-Based Model for Interpretable Text Modeling
    Yu, Peiyu
    Xie, Sirui
    Ma, Xiaojian
    Jia, Baoxiong
    Pang, Bo
    Gao, Ruiqi
    Zhu, Yixin
    Zhu, Song-Chun
    Wu, Ying Nian
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [5] K-space and image domain collaborative energy-based model for parallel MRI reconstruction
    Tu, Zongjiang
    Jiang, Chen
    Guan, Yu
    Liu, Jijun
    Liu, Qiegen
    MAGNETIC RESONANCE IMAGING, 2023, 99 : 110 - 122
  • [6] Learning Energy-Based Prior Model with Diffusion-Amortized MCMC
    Yu, Peiyu
    Zhu, Yaxuan
    Xie, Sirui
    Ma, Xiaojian
    Gao, Ruiqi
    Zhu, Song-Chun
    Wu, Ying Nian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification
    Pang, Bo
    Wu, Ying Nian
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [8] Adaptive Multi-stage Density Ratio Estimation for Learning Latent Space Energy-based Model
    Xiao, Zhisheng
    Han, Tian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [9] EM-LAST: Effective Multidimensional Latent Space Transport for an Unpaired Image-to-Image Translation With an Energy-Based Model
    Han, Giwoong
    Min, Jinhong
    Han, Sung Won
    IEEE ACCESS, 2022, 10 : 72839 - 72849
  • [10] Likelihood-Based Generative Radiance Field with Latent Space Energy-Based Model for 3D-Aware Disentangled Image Representation
    Zhu, Yaxuan
    Xie, Jianwen
    Li, Ping
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 206, 2023, 206