Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction

被引:47
|
作者
Pan, Jiayi [1 ]
Zhang, Heye [1 ]
Wu, Weifei [2 ]
Gao, Zhifan [1 ]
Wu, Weiwen [1 ]
机构
[1] Sun Yat Sen Univ, Sch Biomed Engn, Shenzhen, Guangdong, Peoples R China
[2] China Three Gorges Univ, Peoples Hosp Yichang 1, Peoples Hosp China, Dept Orthoped, Yichang, Hubei, Peoples R China
来源
PATTERNS | 2022年 / 3卷 / 06期
基金
中国国家自然科学基金;
关键词
IMAGE-RECONSTRUCTION; INVERSE PROBLEMS; NEURAL-NETWORK; ALGORITHM;
D O I
10.1016/j.patter.2022.100498
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decreasing projection views to a lower X-ray radiation dose usually leads to severe streak artifacts. To improve image quality from sparse-view data, a multi-domain integrative Swin transformer network (MIST-net) was developed and is reported in this article. First, MIST-net incorporated lavish domain features from data, residual data, image, and residual image using flexible network architectures, where a residual data and residual image sub-network was considered as a data consistency module to eliminate interpolation and reconstruction errors. Second, a trainable edge enhancement filter was incorporated to detect and protect image edges. Third, a high-quality reconstruction Swin transformer (i.e., Recformer) was designed to capture image global features. The experimental results on numerical and real cardiac clinical datasets with 48 views demonstrated that our proposed MIST-net provided better image quality with more small features and sharp edges than other competitors.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Implicit Neural Deformation for Sparse-View Face Reconstruction
    Li, Moran
    Huang, Haibin
    Zheng, Yi
    Li, Mengtian
    Sang, Nong
    Ma, Chongyang
    COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 601 - 610
  • [42] Sparse-View CT Reconstruction Using Wasserstein GANs
    Thaler, Franz
    Hammernik, Kerstin
    Payer, Christian
    Urschler, Martin
    Stern, Darko
    MACHINE LEARNING FOR MEDICAL IMAGE RECONSTRUCTION, MLMIR 2018, 2018, 11074 : 75 - 82
  • [43] Reconstruction of Sparse-View Tomography via Banded Matrices
    Prasad, T.
    Kumar, P. U. Praveen
    Sastry, C. S.
    Jampana, P. V.
    COMPUTER VISION, GRAPHICS, AND IMAGE PROCESSING, ICVGIP 2016, 2017, 10481 : 204 - 215
  • [44] Sparse-view image reconstruction with nonlocal total variation
    Zhang, Hanming
    Yan, Bin
    Wang, Linyuan
    Li, Lei
    Xi, Xiaoqi
    Hu, Guoen
    2014 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE (NSS/MIC), 2014,
  • [45] DEEP BACK PROJECTION FOR SPARSE-VIEW CT RECONSTRUCTION
    Ye, Dong Hye
    Buzzard, Gregery T.
    Ruby, Max
    Bouman, Charles A.
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 1 - 5
  • [46] Sparse-view synchrotron X-ray tomographic reconstruction with learning-based sinogram synthesis
    Cheng, Chang-Chieh
    Chiang, Ming-Hsuan
    Yeh, Chao-Hong
    Lee, Tsung-Tse
    Ching, Yu-Tai
    Hwu, Yeukuang
    Chiang, Ann-Shyn
    JOURNAL OF SYNCHROTRON RADIATION, 2023, 30 (Pt 6) : 1135 - 1142
  • [47] Beam Hardening Correction for Sparse-View CT Reconstruction
    Liu, Wenlei
    Rong, Junyan
    Gao, Peng
    Liao, Qimei
    Lu, HongBing
    MEDICAL IMAGING 2015: IMAGE PROCESSING, 2015, 9413
  • [48] Sparse-View Photoacoustic Reconstruction Method for Diabetic Retinopathy Using Feature Fusion Network
    Chang, Xiaohan
    Cai, Lingbo
    Wang, Jianlei
    Dong, Hongyang
    Han, Jing
    Wang, Chun
    JOURNAL OF BIOPHOTONICS, 2024, 17 (11)
  • [49] Sparse-View CT Reconstruction via Robust and Multi-channels Autoencoding Priors
    Zhang, Minghui
    Zhang, Fengqin
    Liu, Qiegen
    Liang, Dong
    ISICDM 2018: PROCEEDINGS OF THE 2ND INTERNATIONAL SYMPOSIUM ON IMAGE COMPUTING AND DIGITAL MEDICINE, 2018, : 55 - 59