Self-supervised learning for single-pixel imaging via dual-domain constraints

被引:8
|
作者
Chang, Xuyang [1 ,2 ,3 ]
Wu, Ze [1 ,2 ,3 ]
LI, Daoyu [1 ,2 ,3 ]
Zhan, Xinrui [1 ,2 ,3 ]
Yan, Rong [1 ,2 ,3 ]
Bian, Liheng [1 ,2 ,3 ,4 ]
机构
[1] Beijing Inst Technol, MIIT Key Lab Complex Field Intelligent Sensing, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Adv Res Inst Multidisciplinary Sci, Beijing 100081, Peoples R China
[4] Yangtze Delta Reg Acad, Beijing Inst Technol Jiaxing, Jiaxing 314019, Peoples R China
基金
中国国家自然科学基金;
关键词
Compendex;
D O I
10.1364/OL.483886
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep-learning-augmented single-pixel imaging (SPI) provides an efficient solution for target compressive sensing. However, the conventional supervised strategy suffers from laborious training and poor generalization. In this Letter, we report a self-supervised learning method for SPI reconstruction. It introduces dual-domain constraints to integrate the SPI physics model into a neural network. Specifically, in addition to the traditional measurement constraint, an extra transformation constraint is employed to ensure target plane consistency. The transformation constraint uses the invariance of reversible transformation to impose an implicit prior, which avoids the non-uniqueness of measurement constraint. A series of experiments validate that the reported technique realizes self-supervised reconstruction in various complex scenes without any paired data, ground truth, or pre-trained prior. It can tackle the underdetermined degradation and noise, with similar to 3.7-dB improvement on the PSNR index compared with the existing method. (c) 2023 Optica Publishing Group
引用
下载
收藏
页码:1566 / 1569
页数:4
相关论文
共 50 条
  • [1] SDD-Net: self-supervised dual-domain dual-path single-pixel imaging
    Guo, Zhengmin
    Zhou, Pei
    Zhu, Jiangping
    OPTICS EXPRESS, 2024, 32 (17): : 30787 - 30799
  • [2] Dual-Domain Self-supervised Learning and Model Adaption for Deep Compressive Imaging
    Quan, Yuhui
    Qin, Xinran
    Pang, Tongyao
    Ji, Hui
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 409 - 426
  • [3] Dual-domain self-supervised learning for accelerated non-Cartesian MRI reconstruction
    Zhou, Bo
    Schlemper, Jo
    Dey, Neel
    Salehi, Seyed Sadegh Mohseni
    Sheth, Kevin
    Liu, Chi
    Duncan, James S.
    Sofka, Michal
    MEDICAL IMAGE ANALYSIS, 2022, 81
  • [4] Single-pixel imaging based on self-supervised conditional mask classifier-free guidance
    Li, Qianxi
    Yan, Qiurong
    Dong, Jiawei
    Feng, Jia
    Wu, Jiaxin
    Cao, Jianzhong
    Liu, Guangsen
    Wang, Hao
    OPTICS EXPRESS, 2024, 32 (11): : 18771 - 18789
  • [5] Self-Supervised Dual-Domain Network for Low-dose CT Denoising
    Niu, Chuang
    Li, Mengzhou
    Guo, Xiaodong
    Wang, Ge
    DEVELOPMENTS IN X-RAY TOMOGRAPHY XIV, 2022, 12242
  • [6] Joint supervised and unsupervised deep learning method for single-pixel imaging
    Tian, Ye
    Fu, Ying
    Zhang, Jun
    OPTICS AND LASER TECHNOLOGY, 2023, 162
  • [7] ON THE BENEFIT OF DUAL-DOMAIN DENOISING IN A SELF-SUPERVISED LOW-DOSE CT SETTING
    Wagner, Fabian
    Thies, Mareike
    Pfaff, Laura
    Aust, Oliver
    Pechmann, Sabrina
    Weidner, Daniela
    Maul, Noah
    Rohleder, Maximilian
    Gu, Mingxuan
    Utz, Jonas
    Denzinger, Felix
    Maier, Andreas
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [8] DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstruction
    Zhou, Bo
    Dey, Neel
    Liu, Chi
    Schlemper, Jo
    Duncan, James S.
    Salehi, Seyed Sadegh Mohseni
    Sofka, Michal
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4955 - 4964
  • [9] Large-scale single-pixel imaging via deep learning
    Xie, Siyu
    Peng, Lintao
    Bian, Liheng
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY IX, 2022, 12317
  • [10] High speed single-pixel imaging via time domain compressive sampling
    Chen, Hongwei
    Weng, Zhiliang
    Liang, Yunhua
    Lei, Cheng
    Xing, Fangjian
    Chen, Minghua
    Xie, Shizhong
    2014 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2014,