Self-supervised tomographic image noise suppression via residual image prior network

被引:0
|
作者
Pan J. [1 ]
Chang D. [2 ]
Wu W. [1 ]
Chen Y. [3 ]
Wang S. [4 ]
机构
[1] School of Biomedical Engineering, Sun Yat-Sen University, Guangdong, Shenzhen
[2] Institute of Materials, China Academy of Engineering Physics, Sichuan, Mianyang
[3] School of Computer Science and Engineering, Southeast University, Jiangsu, Nanjing
[4] School of Information Engineering, Nanchang University, Jiangxi, Nanchang
基金
中国国家自然科学基金;
关键词
Computed tomography; Noise suppression; Regularization constraint; Residual image; Self-supervised learning;
D O I
10.1016/j.compbiomed.2024.108837
中图分类号
学科分类号
摘要
Computed tomography (CT) denoising is a challenging task in medical imaging that has garnered considerable attention. Supervised networks require a lot of noisy-clean image pairs, which are always unavailable in clinical settings. Existing self-supervised algorithms for suppressing noise with paired noisy images have limitations, such as ignoring the residual between similar image pairs during training and insufficiently learning the spectrum information of images. In this study, we propose a Residual Image Prior Network (RIP-Net) to sufficiently model the residual between the paired similar noisy images. Our approach offers new insights into the field by addressing the limitations of existing methods. We first establish a mathematical theorem clarifying the non-equivalence between similar-image-based self-supervised learning and supervised learning. It helps us better understand the strengths and limitations of self-supervised learning. Secondly, we introduce a novel regularization term to model a low-frequency residual image prior. This can improve the accuracy and robustness of our model. Finally, we design a well-structured denoising network capable of exploring spectrum information while simultaneously sensing context messages. The network has dual paths for modeling high and low-frequency compositions in the raw noisy image. Additionally, context perception modules capture local and global interactions to produce high-quality images. The comprehensive experiments on preclinical photon-counting CT, clinical brain CT, and low-dose CT datasets, demonstrate that our RIP-Net is superior to other unsupervised denoising methods. © 2024 Elsevier Ltd
引用
收藏
相关论文
共 50 条
  • [41] Revisiting Image Aesthetic Assessment via Self-Supervised Feature Learning
    Sheng, Kekai
    Dong, Weiming
    Chai, Menglei
    Wang, Guohui
    Zhou, Peng
    Huang, Feiyue
    Hu, Bao-Gang
    Ji, Rongrong
    Ma, Chongyang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5709 - 5716
  • [42] Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising
    Xie, Yaochen
    Wang, Zhengyang
    Ji, Shuiwang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [43] Self-Supervised Pre-Training for Deep Image Prior-Based Robust PET Image Denoising
    Onishi, Yuya
    Hashimoto, Fumio
    Ote, Kibo
    Matsubara, Keisuke
    Ibaraki, Masanobu
    IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2024, 8 (04) : 348 - 356
  • [44] Self-Supervised Sketch-to-Image Synthesis
    Liu, Bingchen
    Zhu, Yizhe
    Song, Kunpeng
    Elgammal, Ahmed
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2073 - 2081
  • [45] A Self-Supervised Descriptor for Image Copy Detection
    Pizzi, Ed
    Roy, Sreya Dutta
    Ravindra, Sugosh Nagavara
    Goyal, Priya
    Douze, Matthijs
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14512 - 14522
  • [46] SSH: A Self-Supervised Framework for Image Harmonization
    Jiang, Yifan
    Zhang, He
    Zhang, Jianming
    Wang, Yilin
    Lin, Zhe
    Sunkavalli, Kalyan
    Chen, Simon
    Amirghodsi, Sohrab
    Kong, Sarah
    Wang, Zhangyang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4812 - 4821
  • [47] Deep Self-Supervised Hyperspectral Image Reconstruction
    Liu, Zhe
    Han, Xian-Hua
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
  • [48] Leveraging Self-supervised Denoising for Image Segmentation
    Prakash, Mangal
    Buchholz, Tim-Oliver
    Lalit, Manan
    Tomancak, Pavel
    Jug, Florian
    Krull, Alexander
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 428 - 432
  • [49] Self-supervised Learning for Astronomical Image Classification
    Martinazzo, Ana
    Espadoto, Mateus
    Hirata, Nina S. T.
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4176 - 4182
  • [50] Self-supervised Learning for Sonar Image Classification
    Preciado-Grijalva, Alan
    Wehbe, Bilal
    Firvida, Miguel Bande
    Valdenegro-Toro, Matias
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1498 - 1507