Deep learning based MRI reconstruction with transformer

被引:23
|
作者
Wu, Zhengliang [1 ]
Liao, Weibin [1 ]
Yan, Chao [1 ]
Zhao, Mangsuo [2 ]
Liu, Guowen [3 ,4 ,5 ]
Ma, Ning [3 ,4 ,5 ]
Li, Xuesong [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 South St, Beijing 100081, Peoples R China
[2] Tsinghua Univ, Yuquan Hosp, Sch Clin Med, Dept Neurol, Beijing 100039, Peoples R China
[3] Capital Med Univ, Beijing Childrens Hosp, Big Data & Engn Res Ctr, Dept Echocardiog, Beijing 100045, Peoples R China
[4] Beihang Univ, Beijing Adv Innovat Ctr Big Data Based Precis Med, Beijing 100083, Peoples R China
[5] Capital Med Univ, Beijing 100083, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Transformer; Magnetic resonance imaging (MRI); Deep learning; Compress sensing; SPARSE; NETWORK;
D O I
10.1016/j.cmpb.2023.107452
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction meth-ods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersam-pled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR .(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Image Quality and Diagnostic Performance of Accelerated Shoulder MRI With Deep Learning-Based Reconstruction
    Hahn, Seok
    Yi, Jisook
    Lee, Ho-Joon
    Lee, Yedaun
    Lim, Yun-Jung
    Bang, Jin-Young
    Kim, Hyunwoong
    Lee, Joonsung
    AMERICAN JOURNAL OF ROENTGENOLOGY, 2022, 218 (03) : 506 - 516
  • [42] Accelerated Cine Cardiac MRI Using Deep Learning-Based Reconstruction: A Systematic Evaluation
    Pednekar, Amol
    Kocaoglu, Murat
    Wang, Hui
    Tanimoto, Aki
    Tkach, Jean A.
    Lang, Sean
    Taylor, Michael D.
    JOURNAL OF MAGNETIC RESONANCE IMAGING, 2024, 60 (02) : 640 - 650
  • [43] Transformer based deep learning for digital image correlation
    Zhou, Yifei
    Zuo, Qianjiang
    Chen, Nan
    Zhou, Licheng
    Yang, Bao
    Liu, Zejia
    Liu, Yiping
    Tang, Liqun
    Dong, Shoubin
    Jiang, Zhenyu
    OPTICS AND LASERS IN ENGINEERING, 2025, 184
  • [44] Text Detection of Transformer Based on Deep Learning Algorithm
    Cheng, Yu
    Wan, Yiru
    Sima, Yingjie
    Zhang, Yinmei
    Hu, Sanying
    Wu, Shu
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2022, 29 (03): : 861 - 866
  • [45] Object Detection Algorithms Based on Deep Learning and Transformer
    Fu, Miaomiao
    Deng, Miaolei
    Zhang, Dexian
    Computer Engineering and Applications, 2023, 59 (01): : 37 - 48
  • [46] Attention transformer mechanism and fusion-based deep learning architecture for MRI brain tumor classification system
    Tabatabaei, Sadafossadat
    Rezaee, Khosro
    Zhu, Min
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [47] Advanced deep learning-based image reconstruction in lumbar spine MRI at 0.55 T - Effects on image quality and acquisition time in comparison to conventional deep learning-based reconstruction
    Schlicht, Felix
    Vosshenrich, Jan
    Donners, Ricardo
    Seifert, Alina Carolin
    Fenchel, Matthias
    Nickel, Dominik
    Obmann, Markus
    Harder, Dorothee
    Breit, Hanns-Christian
    EUROPEAN JOURNAL OF RADIOLOGY OPEN, 2024, 12
  • [48] Deep Learning Reconstruction for Accelerated Spine MRI: Prospective Analysis of Interchangeability
    Almansour, Haidara
    Herrmann, Judith
    Gassenmaier, Sebastian
    Afat, Saif
    Jacoby, Johann
    Koerzdoerfer, Gregor
    Nickel, Dominik
    Mostapha, Mahmoud
    Nadar, Mariappan
    Othman, Ahmed E.
    RADIOLOGY, 2023, 306 (03)
  • [49] Fast cortical surface reconstruction from MRI using deep learning
    Ren, Jianxun
    Hu, Qingyu
    Wang, Weiwei
    Zhang, Wei
    Hubbard, Catherine S.
    Zhang, Pingjia
    An, Ning
    Zhou, Ying
    Dahmani, Louisa
    Wang, Danhong
    Fu, Xiaoxuan
    Sun, Zhenyu
    Wang, Yezhe
    Wang, Ruiqi
    Li, Luming
    Liu, Hesheng
    BRAIN INFORMATICS, 2022, 9 (01)
  • [50] MRI GUIDED DEEP LEARNING IMAGE RECONSTRUCTION FOR LOW DOSE PET
    Pain, C.
    Sudarshan, V. P.
    Upadhyay, U.
    Awate, S. P.
    Egan, G. F.
    INTERNAL MEDICINE JOURNAL, 2021, 51 : 29 - 30