SMORE: A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning

被引:89
|
作者
Zhao, Can [1 ]
Dewey, Blake E. [1 ,2 ]
Pham, Dzung L. [3 ]
Calabresi, Peter A. [4 ]
Reich, Daniel S. [5 ]
Prince, Jerry L. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Kennedy Krieger Inst, Kirby Ctr Funct Brain Imaging Res, Baltimore, MD 21205 USA
[3] Henry M Jackson Fdn, Ctr Neurosci & Regenerat Med, Bethesda, MD 20817 USA
[4] Johns Hopkins Sch Med, Dept Neurol, Baltimore, MD 21205 USA
[5] NINDS, Translat Neuroradiol Sect, NIH, Bldg 36,Rm 4D04, Bethesda, MD 20892 USA
关键词
Magnetic resonance imaging; Three-dimensional displays; Two dimensional displays; Training data; Protocols; self-supervised; super-resolution; deep network; magnetic resonance imaging; convolutional neural network; anti-aliasing;
D O I
10.1109/TMI.2020.3037187
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-to-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.(2) This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
引用
收藏
页码:805 / 817
页数:13
相关论文
共 50 条
  • [1] A Deep Learning Based Anti-aliasing Self Super-Resolution Algorithm for MRI
    Zhao, Can
    Carass, Aaron
    Dewey, Blake E.
    Woo, Jonghye
    Oh, Jiwon
    Calabresi, Peter A.
    Reich, Daniel S.
    Sati, Pascal
    Pham, Dzung L.
    Prince, Jerry L.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 : 100 - 108
  • [2] Applications of a deep learning method for anti-aliasing and super resolution in MRI
    Zhao, Can
    Shao, Muhan
    Carass, Aaron
    Li, Hao
    Dewey, Blake E.
    Ellingsen, Lotta M.
    Woo, Jonghye
    Guttman, Michael A.
    Blitz, Ari M.
    Stone, Maureen
    Calabresi, Peter A.
    Halperin, Henry
    Prince, Jerry L.
    MAGNETIC RESONANCE IMAGING, 2019, 64 : 132 - 141
  • [3] STRESS: Super-Resolution for Dynamic Fetal MRI Using Self-supervised Learning
    Xu, Junshen
    Turk, Esra Abaci
    Grant, P. Ellen
    Golland, Polina
    Adalsteinsson, Elfar
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VII, 2021, 12907 : 197 - 206
  • [4] Self-Supervised Deep Blind Video Super-Resolution
    Bai, Haoran
    Pan, Jinshan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (07) : 4641 - 4653
  • [5] Deep Unpaired Blind Image Super-Resolution Using Self-supervised Learning and Exemplar Distillation
    Dong, Jiangxin
    Bai, Haoran
    Tang, Jinhui
    Pan, Jinshan
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023,
  • [6] Self-Supervised Burst Super-Resolution
    Bhat, Goutam
    Gharbi, Michael
    Chen, Jiawen
    Van Gool, Luc
    Xia, Zhihao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 10571 - 10580
  • [7] Self-Supervised Learning for Rolling Shutter Temporal Super-Resolution
    Fan, Bin
    Guo, Ying
    Dai, Yuchao
    Xu, Chao
    Shi, Boxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 769 - 782
  • [8] SELF-SUPERVISED ARBITRARY SCALE SUPER-RESOLUTION FRAMEWORK FOR ANISOTROPIC MRI
    Zhang, Haonan
    Zhang, Yuhan
    Wu, Qing
    Wu, Jiangjie
    Zhen, Zhiming
    Shi, Feng
    Yuan, Jianmin
    Wei, Hongjiang
    Liu, Chen
    Zhang, Yuyao
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [9] Analysis of multiframe super-resolution reconstruction for image anti-aliasing and deblurring
    Wang, ZZ
    Qi, FH
    IMAGE AND VISION COMPUTING, 2005, 23 (04) : 393 - 404
  • [10] Hyperspectral image super resolution using deep internal and self-supervised learning
    Liu, Zhe
    Han, Xian-Hua
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (01) : 128 - 141