SMORE: A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning

被引:89
|
作者
Zhao, Can [1 ]
Dewey, Blake E. [1 ,2 ]
Pham, Dzung L. [3 ]
Calabresi, Peter A. [4 ]
Reich, Daniel S. [5 ]
Prince, Jerry L. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Kennedy Krieger Inst, Kirby Ctr Funct Brain Imaging Res, Baltimore, MD 21205 USA
[3] Henry M Jackson Fdn, Ctr Neurosci & Regenerat Med, Bethesda, MD 20817 USA
[4] Johns Hopkins Sch Med, Dept Neurol, Baltimore, MD 21205 USA
[5] NINDS, Translat Neuroradiol Sect, NIH, Bldg 36,Rm 4D04, Bethesda, MD 20892 USA
关键词
Magnetic resonance imaging; Three-dimensional displays; Two dimensional displays; Training data; Protocols; self-supervised; super-resolution; deep network; magnetic resonance imaging; convolutional neural network; anti-aliasing;
D O I
10.1109/TMI.2020.3037187
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-to-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.(2) This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
引用
收藏
页码:805 / 817
页数:13
相关论文
共 50 条
  • [41] Self-Supervised Super-Resolution for Multi-Exposure Push-Frame Satellites
    Ngoc Long Nguyen
    Anger, Jeremy
    Davy, Axel
    Arias, Pablo
    Facciolo, Gabriele
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1848 - 1858
  • [42] Weather Recognition Using Self-supervised Deep Learning
    Acuna-Escobar, Diego
    Intriago-Pazmino, Monserrate
    Ibarra-Fiallo, Julio
    SMART TECHNOLOGIES, SYSTEMS AND APPLICATIONS, SMARTTECH-IC 2021, 2022, 1532 : 161 - 174
  • [43] Image super-resolution algorithm based on deep learning network
    Chen, Jian
    Wang, Xiang
    Li, Qinrui
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2021, 128 : 180 - 181
  • [44] Joint Denoising and Super-Resolution for Fluorescence Microscopy Using Weakly-Supervised Deep Learning
    Tsang, Colin S. C.
    Mok, Tony C. W.
    Chung, Albert C. S.
    MEDICAL OPTICAL IMAGING AND VIRTUAL MICROSCOPY IMAGE ANALYSIS, MOVI 2022, 2022, 13578 : 32 - 41
  • [45] Super-resolution of magnetic systems using deep learning
    D. B. Lee
    H. G. Yoon
    S. M. Park
    J. W. Choi
    G. Chen
    H. Y. Kwon
    C. Won
    Scientific Reports, 13
  • [46] Omnidirectional Video Super-Resolution Using Deep Learning
    Baniya, Arbind Agrahari
    Lee, Tsz-Kwan
    Eklund, Peter W.
    Aryal, Sunil
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 540 - 554
  • [47] Super-resolution of Solar Magnetograms Using Deep Learning
    Fengping Dou
    Long Xu
    Zhixiang Ren
    Dong Zhao
    Xinze Zhang
    ResearchinAstronomyandAstrophysics, 2022, 22 (08) : 220 - 231
  • [48] Super-resolution of Solar Magnetograms Using Deep Learning
    Dou, Fengping
    Xu, Long
    Ren, Zhixiang
    Zhao, Dong
    Zhang, Xinze
    RESEARCH IN ASTRONOMY AND ASTROPHYSICS, 2022, 22 (08)
  • [49] Super-resolution of magnetic systems using deep learning
    Lee, D. B.
    Yoon, H. G.
    Park, S. M.
    Choi, J. W.
    Chen, G.
    Kwon, H. Y.
    Won, C.
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [50] Lightweight Super-Resolution Using Deep Neural Learning
    Jiang, Zhuqing
    Zhu, Honghui
    Lu, Yue
    Ju, Guodong
    Men, Aidong
    IEEE TRANSACTIONS ON BROADCASTING, 2020, 66 (04) : 814 - 823