Deep learning based MRI reconstruction with transformer

被引:23
|
作者
Wu, Zhengliang [1 ]
Liao, Weibin [1 ]
Yan, Chao [1 ]
Zhao, Mangsuo [2 ]
Liu, Guowen [3 ,4 ,5 ]
Ma, Ning [3 ,4 ,5 ]
Li, Xuesong [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 South St, Beijing 100081, Peoples R China
[2] Tsinghua Univ, Yuquan Hosp, Sch Clin Med, Dept Neurol, Beijing 100039, Peoples R China
[3] Capital Med Univ, Beijing Childrens Hosp, Big Data & Engn Res Ctr, Dept Echocardiog, Beijing 100045, Peoples R China
[4] Beihang Univ, Beijing Adv Innovat Ctr Big Data Based Precis Med, Beijing 100083, Peoples R China
[5] Capital Med Univ, Beijing 100083, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Transformer; Magnetic resonance imaging (MRI); Deep learning; Compress sensing; SPARSE; NETWORK;
D O I
10.1016/j.cmpb.2023.107452
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction meth-ods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersam-pled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR .(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Deep learning-based Intraoperative MRI reconstruction
    Ottesen, Jon Andre
    Storas, Tryggve
    Vatnehol, Svein Are Sirirud
    Lovland, Grethe
    Vik-Mo, Einar Osland
    Schellhorn, Till
    Skogen, Karoline
    Larsson, Christopher
    Bjornerud, Atle
    Groote-Eindbaas, Inge Rasmus
    Caan, Matthan W. A.
    EUROPEAN RADIOLOGY EXPERIMENTAL, 2025, 9 (01)
  • [2] Diagnosing Knee Injuries from MRI with Transformer Based Deep Learning
    Sezen, Gokay
    Oksuz, Ilkay
    PREDICTIVE INTELLIGENCE IN MEDICINE (PRIME 2022), 2022, 13564 : 71 - 78
  • [3] DEEP REINFORCEMENT LEARNING BASED UNROLLING NETWORK FOR MRI RECONSTRUCTION
    Wang, Chong
    Zhang, Rongkai
    Maliakal, Gabriel
    Ravishankar, Saiprasad
    Wen, Bihan
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [4] Deep Learning-Based Reconstruction for Cardiac MRI: A Review
    Oscanoa, Julio A.
    Middione, Matthew J.
    Alkan, Cagan
    Yurt, Mahmut
    Loecher, Michael
    Vasanawala, Shreyas S.
    Ennis, Daniel B.
    BIOENGINEERING-BASEL, 2023, 10 (03):
  • [5] Accelerating MRI reconstruction with deep learning
    Lonning, K.
    Caan, M. W. A.
    Sonke, J.
    RADIOTHERAPY AND ONCOLOGY, 2020, 152 : S281 - S281
  • [6] Deep learning for undersampled MRI reconstruction
    Hyun, Chang Min
    Kim, Hwa Pyung
    Lee, Sung Min
    Lee, Sungchul
    Seo, Jin Keun
    PHYSICS IN MEDICINE AND BIOLOGY, 2018, 63 (13):
  • [7] Comparison of deep learning-based reconstruction of PROPELLER Shoulder MRI with conventional reconstruction
    Hahn, Seok
    Yi, Jisook
    Lee, Ho-Joon
    Lee, Yedaun
    Lee, Joonsung
    Wang, Xinzeng
    Fung, Maggie
    SKELETAL RADIOLOGY, 2023, 52 (08) : 1545 - 1555
  • [8] Comparison of deep learning-based reconstruction of PROPELLER Shoulder MRI with conventional reconstruction
    Seok Hahn
    Jisook Yi
    Ho-Joon Lee
    Yedaun Lee
    Joonsung Lee
    Xinzeng Wang
    Maggie Fung
    Skeletal Radiology, 2023, 52 : 1545 - 1555
  • [9] A Review of Optimization-Based Deep Learning Models for MRI Reconstruction
    Bian, Wanyu
    Tamilselvam, Yokhesh Krishnasamy
    APPLIEDMATH, 2024, 4 (03): : 1098 - 1127
  • [10] Non-Learning based Deep Parallel MRI Reconstruction (NLDpMRI)
    Yazdanpanah, Ali Pour
    Afacan, Onur
    Warfield, Simon K.
    MEDICAL IMAGING 2019: IMAGE PROCESSING, 2019, 10949