Deep learning based MRI reconstruction with transformer

被引:23
|
作者
Wu, Zhengliang [1 ]
Liao, Weibin [1 ]
Yan, Chao [1 ]
Zhao, Mangsuo [2 ]
Liu, Guowen [3 ,4 ,5 ]
Ma, Ning [3 ,4 ,5 ]
Li, Xuesong [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 South St, Beijing 100081, Peoples R China
[2] Tsinghua Univ, Yuquan Hosp, Sch Clin Med, Dept Neurol, Beijing 100039, Peoples R China
[3] Capital Med Univ, Beijing Childrens Hosp, Big Data & Engn Res Ctr, Dept Echocardiog, Beijing 100045, Peoples R China
[4] Beihang Univ, Beijing Adv Innovat Ctr Big Data Based Precis Med, Beijing 100083, Peoples R China
[5] Capital Med Univ, Beijing 100083, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Transformer; Magnetic resonance imaging (MRI); Deep learning; Compress sensing; SPARSE; NETWORK;
D O I
10.1016/j.cmpb.2023.107452
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction meth-ods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersam-pled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR .(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] DLGAN: Undersampled MRI reconstruction using Deep Learning based Generative Adversarial Network
    Noor, Rida
    Wahid, Abdul
    Bazai, Sibghat Ullah
    Khan, Asad
    Fang, Meie
    Syam, M. S.
    Bhatti, Uzair Aslam
    Ghadi, Yazeed Yasin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [32] Accelerating cardiac cine MRI using a deep learning-based ESPIRiT reconstruction
    Sandino, Christopher M.
    Lai, Peng
    Vasanawala, Shreyas S.
    Cheng, Joseph Y.
    MAGNETIC RESONANCE IN MEDICINE, 2021, 85 (01) : 166 - 181
  • [33] Frequency Learning via Multi-Scale Fourier Transformer for MRI Reconstruction
    Yi, Qiaosi
    Fang, Faming
    Zhang, Guixu
    Zeng, Tieyong
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (11) : 5506 - 5517
  • [34] Impact of Deep Learning Image Reconstruction Methods on MRI Throughput
    Yang, Anthony
    Finkelstein, Mark
    Koo, Clara
    Doshi, Amish H.
    RADIOLOGY-ARTIFICIAL INTELLIGENCE, 2024, 6 (03)
  • [35] Revolutionizing Shoulder MRI: Accelerated Imaging with Deep Learning Reconstruction
    Chang, Peter D.
    Chow, Daniel S.
    RADIOLOGY, 2024, 310 (01)
  • [36] The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
    Prokopenko, Denis
    Hammernik, Kerstin
    Roberts, Thomas
    Lloyd, David F. A.
    Rueckert, Daniel
    Hajnal, Joseph V.
    PERINATAL, PRETERM AND PAEDIATRIC IMAGE ANALYSIS, PIPPI 2023, 2023, 14246 : 64 - 74
  • [37] Advancing MRI Technology with Deep Learning Super Resolution Reconstruction
    Luetkens, Julian A.
    Kravchenko, Dmitrij
    ACADEMIC RADIOLOGY, 2024, 31 (10) : 4183 - 4184
  • [38] Super-resolution reconstruction of wind fields with a swin-transformer-based deep learning framework
    Tang, Lingxiao
    Li, Chao
    Zhao, Zihan
    Xiao, Yiqing
    Chen, Shenpeng
    PHYSICS OF FLUIDS, 2024, 36 (12)
  • [39] A Joint Group Sparsity-based deep learning for multi-contrast MRI reconstruction
    Guo, Di
    Zeng, Gushan
    Fu, Hao
    Wang, Zi
    Yang, Yonggui
    Qu, Xiaobo
    JOURNAL OF MAGNETIC RESONANCE, 2023, 346
  • [40] Accelerated MRI Reconstruction via Dynamic Deformable Alignment Based Transformer
    Alghallabi, Wafa
    Dudhane, Akshay
    Zamir, Waqas
    Khan, Salman
    Khan, Fahad Shahbaz
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2023, PT I, 2024, 14348 : 104 - 114