SMORE: A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning

被引:89
|
作者
Zhao, Can [1 ]
Dewey, Blake E. [1 ,2 ]
Pham, Dzung L. [3 ]
Calabresi, Peter A. [4 ]
Reich, Daniel S. [5 ]
Prince, Jerry L. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Kennedy Krieger Inst, Kirby Ctr Funct Brain Imaging Res, Baltimore, MD 21205 USA
[3] Henry M Jackson Fdn, Ctr Neurosci & Regenerat Med, Bethesda, MD 20817 USA
[4] Johns Hopkins Sch Med, Dept Neurol, Baltimore, MD 21205 USA
[5] NINDS, Translat Neuroradiol Sect, NIH, Bldg 36,Rm 4D04, Bethesda, MD 20892 USA
关键词
Magnetic resonance imaging; Three-dimensional displays; Two dimensional displays; Training data; Protocols; self-supervised; super-resolution; deep network; magnetic resonance imaging; convolutional neural network; anti-aliasing;
D O I
10.1109/TMI.2020.3037187
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-to-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.(2) This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
引用
收藏
页码:805 / 817
页数:13
相关论文
共 50 条
  • [31] SuperVision: Self-Supervised Super-Resolution for Appearance-Based Gaze Estimation
    O'Shea, Galen
    Komeili, Majid
    GAZE MEETS MACHINE LEARNING WORKSHOP, 2023, 226 : 197 - 217
  • [32] Self-supervised depth super-resolution with contrastive multiview pre-training
    Qiao, Xin
    Ge, Chenyang
    Zhao, Chaoqiang
    Tosi, Fabio
    Poggi, Matteo
    Mattoccia, Stefano
    NEURAL NETWORKS, 2023, 168 : 223 - 236
  • [33] Looking beyond input frames: Self-supervised adaptation for video super-resolution
    Yoo, Jinsu
    Nam, Jihoon
    Baik, Sungyong
    Kim, Tae Hyun
    PATTERN RECOGNITION, 2024, 154
  • [34] Adjustable super-resolution network via deep supervised learning and progressive self-distillation
    Li, Juncheng
    Fang, Faming
    Zeng, Tieyong
    Zhang, Guixu
    Wang, Xizhao
    NEUROCOMPUTING, 2022, 500 : 379 - 393
  • [35] Deep Depth Super-Resolution: Learning Depth Super-Resolution Using Deep Convolutional Neural Network
    Song, Xibin
    Dai, Yuchao
    Qin, Xueying
    COMPUTER VISION - ACCV 2016, PT IV, 2017, 10114 : 360 - 376
  • [36] SelfS2: Self-Supervised Transfer Learning for Sentinel-2 Multispectral Image Super-Resolution
    Qian, Xiao
    Jiang, Tai-Xiang
    Zhao, Xi-Le
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 215 - 227
  • [37] FR-GAN: A self-supervised learning method for super-resolution reconstruction of optical remote sensing images
    Zhong, Hai-Feng
    Sun, Hong-Mei
    Jia, Rui-Sheng
    Zhang, Qi
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (02)
  • [38] REHRSeg: Unleashing the power of self-supervised super-resolution for resource-efficient 3D MRI segmentation
    Song, Zhiyun
    Zhao, Yinjie
    Li, Xiaomin
    Fei, Manman
    Zhao, Xiangyu
    Liu, Mengjun
    Chen, Cunjian
    Yeh, Chung-Hsing
    Wang, Qian
    Zheng, Guoyan
    Ai, Songtao
    Zhang, Lichi
    NEUROCOMPUTING, 2025, 624
  • [39] Self-Supervised Pretraining for Stereoscopic Image Super-Resolution With Parallax-Aware Masking
    Zhang, Zhe
    Lei, Jianjun
    Peng, Bo
    Zhu, Jie
    Huang, Qingming
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (02) : 482 - 491
  • [40] Hyperspectral Image Super-Resolution with Self-Supervised Spectral-Spatial Residual Network
    Chen, Wenjing
    Zheng, Xiangtao
    Lu, Xiaoqiang
    REMOTE SENSING, 2021, 13 (07)