Reducing magnetic resonance image spacing by learning without ground-truth

被引:5
|
作者
Xuan, Kai [1 ]
Si, Liping [3 ]
Zhang, Lichi [1 ]
Xue, Zhong [5 ]
Jiao, Yining [1 ]
Yao, Weiwu [3 ]
Shen, Dinggang [4 ,5 ,6 ]
Wu, Dijia [5 ]
Wang, Qian [2 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200030, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Biomed Engn, Med Image Comp Lab, Shanghai 200030, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Med, Tongren Hosp, Dept Imaging, Shanghai 200050, Peoples R China
[4] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[5] Shanghai United Imaging Intelligence Co Ltd, Shanghai 200230, Peoples R China
[6] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
关键词
Generative adversarial network; Magnetic resonance imaging; Super-resolution; Super Variational auto-encoder; SUPERRESOLUTION; RECONSTRUCTION;
D O I
10.1016/j.patcog.2021.108103
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-quality magnetic resonance (MR) image, i.e., with near isotropic voxel spacing, is desirable in various scenarios of medical image analysis. However, many MR images are acquired using good in-plane resolution but large spacing between slices in clinical practice. In this work, we propose a novel deep-learning based super-resolution algorithm to generate high-resolution (HR) MR images of small slice spacing from low-resolution (LR) inputs of large slice spacing. Notice that real HR images are needed in most existing deep-learning-based methods to supervise the training, but in clinical scenarios, usually they will not be acquired. Therefore, our unique goal herein is to design and train the super-resolution network without real HR ground-truth. Specifically, two-staged training is used in our method. In the first stage, HR images of reduced slice spacing are synthesized from real LR images using variational auto-encoder (VAE). Although these synthesized HR images of reduced slice spacing are as realistic as possible, they may still suffer from unexpected morphing induced by VAE, implying that the synthesized HR images cannot be paired with the real LR images in terms of anatomical structure details. In the second stage, we degrade the synthesized HR images to generate corresponding LR-HR image pairs and train a super-resolution network based on these synthesized pairs. The underlying mechanism is that such a super-resolution network is less vulnerable to anatomical variability. Experiments on knee MR images successfully demonstrate the effectiveness of our proposed solution to reduce the slice spacing for better rendering. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Training Image Estimators without Image Ground-Truth
    Xia, Zhihao
    Chakrabarti, Ayan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [2] Anatomy-Constrained Contrastive Learning for Synthetic Segmentation Without Ground-Truth
    Zhou, Bo
    Liu, Chi
    Duncan, James S.
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I, 2021, 12901 : 47 - 56
  • [3] Qualitative Tracking Performance Evaluation without Ground-Truth
    Han, Bohyung
    Hamm, Jihun
    [J]. 2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, : 55 - 62
  • [4] Optical Image Classification: A Ground-Truth Design Framework
    Pasolli, Edoardo
    Melgani, Farid
    Alajlan, Naif
    Conci, Nicola
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (06): : 3580 - 3597
  • [5] A Ground-Truth Fusion Method for Image Segmentation Evaluation
    Malladi, Sree Ramya S. P.
    Ram, Sundaresh
    Rodriguez, Jeffrey J.
    [J]. 2018 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION (SSIAI), 2018, : 137 - 140
  • [6] Reinforcement Learning-Based Odometry Prediction Network Trained Without Ground-Truth
    Ko, Yeongmin
    Pyo, Junbom
    Seol, Yeonsu
    Jeon, Moongu
    [J]. Automation, Robotics and Communications for Industry 4.0/5.0, 2023, 2023 : 118 - 119
  • [7] Statistic Metrics for Evaluation of Binary Classifiers without Ground-Truth
    Fedorchuk, Maksym
    Lamiroy, Bart
    [J]. 2017 IEEE FIRST UKRAINE CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (UKRCON), 2017, : 1066 - 1071
  • [8] Automatic ground-truth generation for document image analysis and understanding
    Heroux, Pierre
    Barbu, Eugen
    Adam, Sebastien
    Trupin, Eric
    [J]. ICDAR 2007: NINTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS I AND II, PROCEEDINGS, 2007, : 476 - 480
  • [9] Evaluation of Tracking Algorithm Performance without Ground-Truth Data
    Spampinato, C.
    Palazzo, S.
    Giordano, D.
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1345 - 1348
  • [10] Supporting Ground-Truth annotation of image datasets using clustering
    Boom, Bastiaan J.
    Huang, Phoenix X.
    He, Jiyin
    Fisher, Robert B.
    [J]. 2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 1542 - 1545