Practical Compact Deep Compressed Sensing

被引:0
|
作者
Chen, Bin [1 ]
Zhang, Jian [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial neural networks; Image reconstruction; Imaging; Matrix converters; Hardware; Filtering; Training; Signal processing algorithms; Optimization; Micromirrors; Compressed sensing; sampling matrix; single-pixel imaging; algorithm unrolling; and structural reparameterization; CONSTRUCTION; NETWORK; IMAGES;
D O I
10.1109/TPAMI.2024.3504490
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical and compact network dubbed PCNet for general image CS. Specifically, in PCNet, a novel collaborative sampling operator is designed, which consists of a deep conditional filtering step and a dual-branch fast sampling step. The former learns an implicit representation of a linear transformation matrix into a few convolutions and first performs adaptive local filtering on the input image, while the latter then uses a discrete cosine transform and a scrambled block- diagonal Gaussian matrix to generate under-sampled measurements. Our PCNet is equipped with an enhanced proximal gradient descent algorithm-unrolled network for reconstruction. It offers flexibility, interpretability, and strong recovery performance for arbitrary sampling rates once trained. Additionally, we provide a deployment-oriented extraction scheme for single-pixel CS imaging systems, which allows for the convenient conversion of any linear sampling operator to its matrix form to be loaded onto hardware like digital micro-mirror devices. Extensive experiments on natural image CS, quantized CS, and self-supervised CS demonstrate the superior reconstruction accuracy and generalization ability of PCNet compared to existing state-of-the-art methods, particularly for high-resolution images.
引用
收藏
页码:1610 / 1626
页数:17
相关论文
共 50 条
  • [41] Practical privacy-preserving compressed sensing image recovery in the cloud
    Kai Huang
    Ming Xu
    Shaojing Fu
    Dongsheng Wang
    Science China Information Sciences, 2017, 60
  • [42] A Practical Compressed Sensing-Based Pan-Sharpening Method
    Jiang, Cheng
    Zhang, Hongyan
    Shen, Huanfeng
    Zhang, Liangpei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2012, 9 (04) : 629 - 633
  • [43] MULTI-SCALE DEEP NETWORKS FOR IMAGE COMPRESSED SENSING
    Shi, Wuzhen
    Jiang, Feng
    Liu, Shaohui
    Zhao, Debin
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 46 - 50
  • [44] Compressed Video Sensing Based on Deep Generative Adversarial Network
    Nezhad, Valiyeh Ansarian
    Azghani, Masoumeh
    Marvasti, Farokh
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2024, 43 (08) : 5048 - 5064
  • [45] Adaptive deep learning network for image reconstruction of compressed sensing
    Nan, Ruili
    Sun, Guiling
    Zheng, Bowen
    Wang, Lin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (02) : 1463 - 1475
  • [46] A Deep Network Based on Wavelet Transform for Image Compressed Sensing
    Zhu Yin
    Zhongcheng Wu
    Jun Zhang
    Circuits, Systems, and Signal Processing, 2022, 41 : 6031 - 6050
  • [47] A Very Deep Densely Connected Network for Compressed Sensing MRI
    Zeng, Kun
    Yang, Yu
    Xiao, Guobao
    Chen, Zhong
    IEEE ACCESS, 2019, 7 : 85430 - 85439
  • [48] Compressed Sensing via a Deep Convolutional Auto-encoder
    Wu, Hao
    Zheng, Ziyang
    Li, Yong
    Dai, Wenrui
    Xiong, Hongkai
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [49] DEEP LEARNING SPARSE TERNARY PROJECTIONS FOR COMPRESSED SENSING OF IMAGES
    Duc Minh Nguyen
    Tsiligianni, Evaggelia
    Deligiannis, Nikos
    2017 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2017), 2017, : 1125 - 1129
  • [50] Adaptive Sampling for Image Compressed Sensing Based on Deep Learning
    Zhong, Liqun
    Wan, Shuai
    Xie, Leyi
    2019 3RD INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2019), 2019, 1229