SMORE: A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning

被引:89
|
作者
Zhao, Can [1 ]
Dewey, Blake E. [1 ,2 ]
Pham, Dzung L. [3 ]
Calabresi, Peter A. [4 ]
Reich, Daniel S. [5 ]
Prince, Jerry L. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Kennedy Krieger Inst, Kirby Ctr Funct Brain Imaging Res, Baltimore, MD 21205 USA
[3] Henry M Jackson Fdn, Ctr Neurosci & Regenerat Med, Bethesda, MD 20817 USA
[4] Johns Hopkins Sch Med, Dept Neurol, Baltimore, MD 21205 USA
[5] NINDS, Translat Neuroradiol Sect, NIH, Bldg 36,Rm 4D04, Bethesda, MD 20892 USA
关键词
Magnetic resonance imaging; Three-dimensional displays; Two dimensional displays; Training data; Protocols; self-supervised; super-resolution; deep network; magnetic resonance imaging; convolutional neural network; anti-aliasing;
D O I
10.1109/TMI.2020.3037187
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-to-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.(2) This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
引用
收藏
页码:805 / 817
页数:13
相关论文
共 50 条
  • [21] Generalised Super Resolution for Quantitative MRI Using Self-supervised Mixture of Experts
    Lin, Hongxiang
    Zhou, Yukun
    Slator, Paddy J.
    Alexander, Daniel C.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 44 - 54
  • [22] Self-supervised blind image super-resolution via alternately optimization
    Li, Yinong
    Yu, Jing
    Xiao, Chuangbai
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (05)
  • [23] Self-Supervised Video Super-Resolution by Spatial Constraint and Temporal Fusion
    Yang, Cuixin
    Luo, Hongming
    Liao, Guangsen
    Lu, Zitao
    Zhou, Fei
    Qiu, Guoping
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 249 - 260
  • [24] Self-Supervised Learning for Spatial-Domain Light-Field Super-Resolution Imaging
    Liang Dan
    Zhang Haimiao
    Qiu Jun
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (04)
  • [25] Self-supervised Learning for Real-World Super-Resolution from Dual Zoomed Observations
    Zhang, Zhilu
    Wang, Ruohao
    Zhang, Hongzhi
    Chen, Yunjin
    Zuo, Wangmeng
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 610 - 627
  • [26] Self-Supervised Learning for Real-World Super-Resolution From Dual and Multiple Zoomed Observations
    Zhang, Zhilu
    Wang, Ruohao
    Zhang, Hongzhi
    Zuo, Wangmeng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (03) : 1348 - 1361
  • [27] Perception consistency ultrasound image super-resolution via self-supervised CycleGAN
    Heng Liu
    Jianyong Liu
    Shudong Hou
    Tao Tao
    Jungong Han
    Neural Computing and Applications, 2023, 35 : 12331 - 12341
  • [28] Self-supervised spectral super-resolution for a fast hyperspectral and multispectral image fusion
    Rajaei, Arash
    Abiri, Ebrahim
    Helfroush, Mohammad Sadegh
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [29] Self-Supervised Super-Resolution for Anisotropic MR Images with and Without Slice Gap
    Remedios, Samuel W.
    Han, Shuo
    Zuo, Lianrui
    Carass, Aaron
    Pham, Dzung L.
    Prince, Jerry L.
    Dewey, Blake E.
    SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2023, 2023, 14288 : 118 - 128
  • [30] Perception consistency ultrasound image super-resolution via self-supervised CycleGAN
    Liu, Heng
    Liu, Jianyong
    Hou, Shudong
    Tao, Tao
    Han, Jungong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (17): : 12331 - 12341