Self-supervised learning for single-pixel imaging via dual-domain constraints

被引:8
|
作者
Chang, Xuyang [1 ,2 ,3 ]
Wu, Ze [1 ,2 ,3 ]
LI, Daoyu [1 ,2 ,3 ]
Zhan, Xinrui [1 ,2 ,3 ]
Yan, Rong [1 ,2 ,3 ]
Bian, Liheng [1 ,2 ,3 ,4 ]
机构
[1] Beijing Inst Technol, MIIT Key Lab Complex Field Intelligent Sensing, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Adv Res Inst Multidisciplinary Sci, Beijing 100081, Peoples R China
[4] Yangtze Delta Reg Acad, Beijing Inst Technol Jiaxing, Jiaxing 314019, Peoples R China
基金
中国国家自然科学基金;
关键词
Compendex;
D O I
10.1364/OL.483886
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep-learning-augmented single-pixel imaging (SPI) provides an efficient solution for target compressive sensing. However, the conventional supervised strategy suffers from laborious training and poor generalization. In this Letter, we report a self-supervised learning method for SPI reconstruction. It introduces dual-domain constraints to integrate the SPI physics model into a neural network. Specifically, in addition to the traditional measurement constraint, an extra transformation constraint is employed to ensure target plane consistency. The transformation constraint uses the invariance of reversible transformation to impose an implicit prior, which avoids the non-uniqueness of measurement constraint. A series of experiments validate that the reported technique realizes self-supervised reconstruction in various complex scenes without any paired data, ground truth, or pre-trained prior. It can tackle the underdetermined degradation and noise, with similar to 3.7-dB improvement on the PSNR index compared with the existing method. (c) 2023 Optica Publishing Group
引用
下载
收藏
页码:1566 / 1569
页数:4
相关论文
共 50 条
  • [31] Efficient spectral single-pixel imaging via Morton frequency-domain scanning [Invited]
    Zhao, Zi-Dong
    Yang, Zhao-Hua
    Zhao, Zhi-Hao
    Wu, Ling-An
    Yu, Yuan-Jin
    CHINESE OPTICS LETTERS, 2024, 22 (06)
  • [32] A Novel Compressive Optical Encryption via Single-Pixel Imaging
    Zhang, Chenggong
    Han, Bennian
    He, Wenqi
    Peng, Xiang
    Xu, Chen
    IEEE PHOTONICS JOURNAL, 2019, 11 (04):
  • [33] Spatial frequency domain imaging technology based on Fourier single-pixel imaging
    Ren, Hui M.
    Deng, Guoqing
    Zhou, Peng
    Kang, Xu
    Zhang, Yang
    Ni, Jingshu
    Zhang, Yuanzhi
    Wang, Yikun
    JOURNAL OF BIOMEDICAL OPTICS, 2022, 27 (01)
  • [34] Fourier Single-Pixel Imaging Via Arbitrary Illumination Patterns
    Liu, Zhan-Dong
    Li, Zong-Guo
    Zhao, Ya-Nan
    Zhang, Su-Heng
    Ye, Zhi-Yuan
    Zhang, De-Jian
    Liu, Hong-Chao
    Xiong, Jun
    Li, Hong-Guo
    PHYSICAL REVIEW APPLIED, 2023, 19 (04)
  • [35] Fast Fourier single-pixel imaging via binary illumination
    Zhang, Zibang
    Wang, Xueying
    Zheng, Guoan
    Zhong, Jingang
    SCIENTIFIC REPORTS, 2017, 7
  • [36] Single-pixel imaging via adaptive Stockwell basis selection
    Tang, Zixin
    Zhang, Jianwei
    Xu, Zhenyu
    Ye, Mao
    Liu, Yiguang
    OPTIK, 2022, 257
  • [37] Self-Supervised Learning for Domain Adaptation on Point Clouds
    Achituve, Idan
    Maron, Haggai
    Chechik, Gal
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 123 - 133
  • [38] Improving Imaging Quality of Real-time Fourier Single-pixel Imaging via Deep Learning
    Rizvi, Saad
    Cao, Jie
    Zhang, Kaiyu
    Hao, Qun
    SENSORS, 2019, 19 (19)
  • [39] PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation
    Chen, Mu
    Zheng, Zhedong
    Yang, Yi
    Chua, Tat-Seng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1905 - 1914
  • [40] Single-pixel imaging using physics enhanced deep learning
    FEI WANG
    CHENGLONG WANG
    CHENJIN DENG
    SHENSHENG HAN
    GUOHAI SITU
    Photonics Research, 2022, 10 (01) : 104 - 110