Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

被引:0
|
作者
Zhang, Kuiyuan [1 ]
Hua, Zhongyun [1 ]
Li, Yuanman [2 ,3 ]
Zhang, Yushu [4 ]
Zhou, Yicong [5 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518055, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Transformers; Task analysis; Computer architecture; Image coding; Iterative methods; Extraterrestrial measurements; Compressive sensing service; compressive sampling; image reconstruction; adaptive sampling; deep learning; RECONSTRUCTION; ALGORITHMS;
D O I
10.1109/TSC.2023.3334446
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.
引用
收藏
页码:2974 / 2988
页数:15
相关论文
共 50 条
  • [21] MBUTransNet: multi-branch U-shaped network fusion transformer architecture for medical image segmentation
    JunBo Qiao
    Xing Wang
    Ji Chen
    MingTao Liu
    International Journal of Computer Assisted Radiology and Surgery, 2023, 18 : 1895 - 1902
  • [22] MBUTransNet: multi-branch U-shaped network fusion transformer architecture for medical image segmentation
    Qiao, JunBo
    Wang, Xing
    Chen, Ji
    Liu, MingTao
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2023, 18 (10) : 1895 - 1902
  • [23] U-Shaped Attention Connection Network for Remote-Sensing Image Super-Resolution
    Jiang, Wenzong
    Zhao, Lifei
    Wang, Yan-Jiang
    Liu, Weifeng
    Liu, Bao-Di
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [24] Attention U-shaped network for hyperspectral image classification
    Wang, Ruirui
    Liu, Bing
    Yu, Anzhu
    Wang, Wenjie
    Jiao, Xuejun
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (03)
  • [25] A survey on U-shaped networks in medical image segmentations
    Liu, Liangliang
    Cheng, Jianhong
    Quan, Quan
    Wu, Fang-Xiang
    Wang, Yu-Ping
    Wang, Jianxin
    NEUROCOMPUTING, 2020, 409 (409) : 244 - 258
  • [26] U2-Former: Nested U-Shaped Transformer for Image Restoration via Multi-View Contrastive Learning
    Feng, Xin
    Ji, Haobo
    Pei, Wenjie
    Li, Jinxing
    Lu, Guangming
    Zhang, David
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 168 - 181
  • [27] Transformer-Based Cascade U-shaped Network for Action Segmentation
    Bao, Wenxia
    Lin, An
    Huang, Hua
    Yang, Xianjun
    Chen, Hemu
    2024 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MEDIA COMPUTING, ICIPMC 2024, 2024, : 157 - 161
  • [28] A deep supervised transformer U-shaped full-resolution residual network for the segmentation of breast ultrasound image
    Zhou, Jiale
    Hou, Zuoxun
    Lu, Hongyan
    Wang, Wenhan
    Zhao, Wanchen
    Wang, Zenan
    Zheng, Dezhi
    Wang, Shuai
    Tang, Wenzhong
    Qu, Xiaolei
    MEDICAL PHYSICS, 2023, 50 (12) : 7513 - 7524
  • [29] Remote Sensing Image Fusion Based on Two- branch U- shaped Transformer
    Fan Wensheng
    Liu Fan
    Li Ming
    ACTA PHOTONICA SINICA, 2023, 52 (04)
  • [30] Hybrid Attention-Based U-Shaped Network for Remote Sensing Image Super-Resolution
    Wang, Jiarui
    Wang, Binglu
    Wang, Xiaoxu
    Zhao, Yongqiang
    Long, Teng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61