Practical Compact Deep Compressed Sensing

被引:0
|
作者
Chen, Bin [1 ]
Zhang, Jian [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial neural networks; Image reconstruction; Imaging; Matrix converters; Hardware; Filtering; Training; Signal processing algorithms; Optimization; Micromirrors; Compressed sensing; sampling matrix; single-pixel imaging; algorithm unrolling; and structural reparameterization; CONSTRUCTION; NETWORK; IMAGES;
D O I
10.1109/TPAMI.2024.3504490
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical and compact network dubbed PCNet for general image CS. Specifically, in PCNet, a novel collaborative sampling operator is designed, which consists of a deep conditional filtering step and a dual-branch fast sampling step. The former learns an implicit representation of a linear transformation matrix into a few convolutions and first performs adaptive local filtering on the input image, while the latter then uses a discrete cosine transform and a scrambled block- diagonal Gaussian matrix to generate under-sampled measurements. Our PCNet is equipped with an enhanced proximal gradient descent algorithm-unrolled network for reconstruction. It offers flexibility, interpretability, and strong recovery performance for arbitrary sampling rates once trained. Additionally, we provide a deployment-oriented extraction scheme for single-pixel CS imaging systems, which allows for the convenient conversion of any linear sampling operator to its matrix form to be loaded onto hardware like digital micro-mirror devices. Extensive experiments on natural image CS, quantized CS, and self-supervised CS demonstrate the superior reconstruction accuracy and generalization ability of PCNet compared to existing state-of-the-art methods, particularly for high-resolution images.
引用
收藏
页码:1610 / 1626
页数:17
相关论文
共 50 条
  • [1] Deep Compressed Sensing
    Wu, Yan
    Rosca, Mihaela
    Lillicrap, Timothy
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [2] Deep Blind Compressed Sensing
    Singh, Shikha
    Singhal, Vanika
    Majumdar, Angshul
    2017 DATA COMPRESSION CONFERENCE (DCC), 2017, : 459 - 459
  • [3] Practical Compression Methods for Quantized Compressed Sensing
    Leinonen, Markus
    Codreanu, Marian
    Juntti, Markku
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM 2019 WKSHPS), 2019, : 756 - 761
  • [4] DEEP NETWORKS FOR COMPRESSED IMAGE SENSING
    Shi, Wuzhen
    Jiang, Feng
    Zhang, Shengping
    Zhao, Debin
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 877 - 882
  • [5] Compact and robust hyperspectral camera based on compressed sensing
    Zidek, K.
    Denk, O.
    Hlubucek, J.
    Vaclavik, J.
    OPTICS AND MEASUREMENT INTERNATIONAL CONFERENCE 2016, 2016, 10151
  • [6] Practical Considerations in Applying Compressed Sensing to Simulation Data
    Fan, Ya Ju
    Kamath, Chandrika
    2015 DATA COMPRESSION CONFERENCE (DCC), 2015, : 479 - 479
  • [7] Practical Compressed Sensing with Log-of-Prime Projections
    Moghadam, Abdolreza Abdolhosseini
    Radha, Hayder
    2009 43RD ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, VOLS 1 AND 2, 2009, : 751 - 756
  • [8] Compressed sensing for practical optical imaging systems: a tutorial
    Willett, Rebecca M.
    Marcia, Roummel F.
    Nichols, Jonathan M.
    OPTICAL ENGINEERING, 2011, 50 (07)
  • [9] Compressed Edge Spectrum Sensing: Extensions and practical considerations
    Beck, Edgar
    Bockelmann, Carsten
    Dekorsy, Armin
    AT-AUTOMATISIERUNGSTECHNIK, 2019, 67 (01) : 51 - 59
  • [10] Compressed sensing for practical optical imaging systems: A tutorial
    Willett, Rebecca M.
    Marcia, Roummel F.
    Nichols, Jonathan
    2012 IEEE PHOTONICS CONFERENCE (IPC), 2012, : 586 - 586