IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction

被引:21
|
作者
Zang, Guangming [1 ]
Idoughi, Ramzi [1 ]
Li, Rui [1 ]
Wonka, Peter [1 ]
Heidrich, Wolfgang [1 ]
机构
[1] KAUST, Thuwal, Saudi Arabia
关键词
X-RAY TOMOGRAPHY; RECONSTRUCTION; CT; SUPERRESOLUTION; ALGORITHM; CONVERGENCE; MICROSCOPY; NETWORK; FIELDS; SCENES;
D O I
10.1109/ICCV48922.2021.00197
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose IntraTomo, a powerful framework that combines the benefits of learning-based and model-based approaches for solving highly ill-posed inverse problems in the Computed Tomography (CT) context. IntraTomo is composed of two core modules: a novel sinogram prediction module, and a geometry refinement module, which are applied iteratively. In the first module, the unknown density field is represented as a continuous and differentiable function, parameterized by a deep neural network. This network is learned, in a self-supervised fashion, from the incomplete or/and degraded input sinogram. After getting estimated through the sinogram prediction module, the density field is consistently refined in the second module using local and non-local geometrical priors. With these two core modules, we show that IntraTomo significantly outperforms existing approaches on several ill-posed inverse problems, such as limited angle tomography with a range of 45 degrees, sparse view tomographic reconstruction with as few as eight views, or super-resolution tomography with eight times increased resolution. The experiments on simulated and real data show that our approach can achieve results of unprecedented quality.
引用
收藏
页码:1940 / 1950
页数:11
相关论文
共 50 条
  • [1] Prediction of freezing of gait based on self-supervised pretraining via contrastive learning
    Xia, Yi
    Sun, Hua
    Zhang, Baifu
    Xu, Yangyang
    Ye, Qiang
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 89
  • [2] Self-Supervised Representation Learning via Latent Graph Prediction
    Xie, Yaochen
    Xu, Zhao
    Ji, Shuiwang
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [3] Self-supervised learning-based underwater acoustical signal classification via mask modeling
    Xu, Kele
    Xu, Qisheng
    You, Kang
    Zhu, Boqing
    Feng, Ming
    Feng, Dawei
    Liu, Bo
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2023, 154 (01): : 5 - 15
  • [4] BADGR: An Autonomous Self-Supervised Learning-Based Navigation System
    Kahn, Gregory
    Abbeel, Pieter
    Levine, Sergey
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 1312 - 1319
  • [5] Traffic Prediction with Self-Supervised Learning: A Heterogeneity-Aware Model for Urban Traffic Flow Prediction Based on Self-Supervised Learning
    Gao, Min
    Wei, Yingmei
    Xie, Yuxiang
    Zhang, Yitong
    [J]. MATHEMATICS, 2024, 12 (09)
  • [6] Self-supervised Spatiotemporal Learning via Video Clip Order Prediction
    Xu, Dejing
    Xiao, Jun
    Zhao, Zhou
    Shao, Jian
    Xie, Di
    Zhuang, Yueting
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10326 - 10335
  • [7] Self-supervised learning based on Transformer for flow reconstruction and prediction
    Xu, Bonan
    Zhou, Yuanye
    Bian, Xin
    [J]. PHYSICS OF FLUIDS, 2024, 36 (02)
  • [8] Bearings RUL prediction based on contrastive self-supervised learning
    Deng, WeiKun
    Nguyen, Khanh T. P.
    Medjaher, Kamal
    Gogu, Christian
    Morio, Jerome
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 11906 - 11911
  • [9] Supervised and self-supervised learning-based cascade spatiotemporal fusion framework and its application
    Sun, Weixuan
    Li, Jie
    Jiang, Menghui
    Yuan, Qiangqiang
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 203 : 19 - 36
  • [10] KD-PatchMatch: A Self-Supervised Training Learning-Based PatchMatch
    Tan, Qingyu
    Fang, Zhijun
    Jiang, Xiaoyan
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (04):