Deep learning based MRI reconstruction with transformer

被引:23
|
作者
Wu, Zhengliang [1 ]
Liao, Weibin [1 ]
Yan, Chao [1 ]
Zhao, Mangsuo [2 ]
Liu, Guowen [3 ,4 ,5 ]
Ma, Ning [3 ,4 ,5 ]
Li, Xuesong [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 South St, Beijing 100081, Peoples R China
[2] Tsinghua Univ, Yuquan Hosp, Sch Clin Med, Dept Neurol, Beijing 100039, Peoples R China
[3] Capital Med Univ, Beijing Childrens Hosp, Big Data & Engn Res Ctr, Dept Echocardiog, Beijing 100045, Peoples R China
[4] Beihang Univ, Beijing Adv Innovat Ctr Big Data Based Precis Med, Beijing 100083, Peoples R China
[5] Capital Med Univ, Beijing 100083, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Transformer; Magnetic resonance imaging (MRI); Deep learning; Compress sensing; SPARSE; NETWORK;
D O I
10.1016/j.cmpb.2023.107452
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction meth-ods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersam-pled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR .(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Research on A Multi-slice MRI Reconstruction Algorithm Based on Deep Learning
    Lin, Ziyu
    2022 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY, HUMAN-COMPUTER INTERACTION AND ARTIFICIAL INTELLIGENCE, VRHCIAI, 2022, : 261 - 267
  • [22] Deep Learning Reconstruction of Prospectively Accelerated MRI of the Pancreas
    Chaika, Marianna
    Brendel, Jan M.
    Ursprung, Stephan
    Herrmann, Judith
    Gassenmaier, Sebastian
    Brendlin, Andreas
    Werner, Sebastian
    Nickel, Marcel Dominik
    Nikolaou, Konstantin
    Afat, Saif
    Almansour, Haidara
    INVESTIGATIVE RADIOLOGY, 2025, 60 (02) : 123 - 130
  • [23] Deep learning-based reconstruction for acceleration of lumbar spine MRI: a prospective comparison with standard MRI
    Yoo, Hyunsuk
    Yoo, Roh-Eul
    Choi, Seung Hong
    Hwang, Inpyeong
    Lee, Ji Ye
    Seo, June Young
    Koh, Seok Young
    Choi, Kyu Sung
    Kang, Koung Mi
    Yun, Tae Jin
    EUROPEAN RADIOLOGY, 2023, 33 (12) : 8656 - 8668
  • [24] IMAGE QUALITY AFFECTS DEEP LEARNING RECONSTRUCTION OF MRI
    Jeelani, Haris
    Martin, Jonathan
    Vasquez, Francis
    Salerno, Michael
    Weller, Daniel S.
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 357 - 360
  • [25] Super-resolution reconstruction of turbulent flows with a transformer-based deep learning framework
    Xu, Qin
    Zhuang, Zijian
    Pan, Yongcai
    Wen, Binghai
    PHYSICS OF FLUIDS, 2023, 35 (05)
  • [26] Single-view Cone beam CT reconstruction with Swin Transformer based deep learning
    Huang, Shien
    Song, Yonghong
    Rong, Junyan
    Liu, Tianshuai
    Huang, Dong
    Lu, Hongbing
    MEDICAL IMAGING 2023, 2023, 12464
  • [27] Deep-Learning-Based Few-Angle Cardiac SPECT Reconstruction Using Transformer
    Xie, Huidong
    Thorn, Stephanie
    Liu, Yi-Hwa
    Lee, Supum
    Liu, Zhao
    Wang, Ge
    Sinusas, Albert J.
    Liu, Chi
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2023, 7 (01) : 33 - 40
  • [28] Reference-based MRI Reconstruction Using Texture Transformer
    Guo, Pengfei
    Patel, Vishal M.
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 599 - 616
  • [29] Deep Learning-Based Fast MRI Reconstruction: Improving Generalization for Clinical Translation
    Avidan, Nitzan
    Freiman, Moti
    CLINICAL IMAGE-BASED PROCEDURES, FAIRNESS OF AI IN MEDICAL IMAGING, AND ETHICAL AND PHILOSOPHICAL ISSUES IN MEDICAL IMAGING, CLIP 2023, FAIMI 2023, EPIMI 2023, 2023, 14242 : 59 - 69
  • [30] Accelerated Cardiac MRI with Deep Learning-based Image Reconstruction for Cine Imaging
    Klemenz, Ann-Christin
    Reichardt, Linda
    Gorodezky, Margarita
    Manzke, Mathias
    Zhu, Xucheng
    Dalmer, Antonia
    Lorbeer, Roberto
    Lang, Cajetan I.
    Meinel, Felix G.
    RADIOLOGY-CARDIOTHORACIC IMAGING, 2024, 6 (06):