Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

被引:0
|
作者
Zhang, Kuiyuan [1 ]
Hua, Zhongyun [1 ]
Li, Yuanman [2 ,3 ]
Zhang, Yushu [4 ]
Zhou, Yicong [5 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518055, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Transformers; Task analysis; Computer architecture; Image coding; Iterative methods; Extraterrestrial measurements; Compressive sensing service; compressive sampling; image reconstruction; adaptive sampling; deep learning; RECONSTRUCTION; ALGORITHMS;
D O I
10.1109/TSC.2023.3334446
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.
引用
收藏
页码:2974 / 2988
页数:15
相关论文
共 50 条
  • [41] STM-UNet: An Efficient U-shaped Architecture Based on Swin Transformer and Multiscale MLP for Medical Image Segmentation
    Shi, Lei
    Gao, Tianyu
    Zhang, Zheng
    Zhang, Junxing
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2003 - 2008
  • [42] FTUNet: A Feature-Enhanced Network for Medical Image Segmentation Based on the Combination of U-Shaped Network and Vision Transformer
    Wang, Yuefei
    Yu, Xi
    Yang, Yixi
    Zeng, Shijie
    Xu, Yuquan
    Feng, Ronghui
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [43] Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment
    Zhou, Mingliang
    Chen, Lei
    Wei, Xuekai
    Liao, Xingran
    Mao, Qin
    Wang, Heqiang
    Pu, Huayan
    Luo, Jun
    Xiang, Tao
    Fang, Bin
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (02) : 396 - 405
  • [44] MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation
    Xi, Heran
    Dong, Haoji
    Sheng, Yue
    Cui, Hui
    Huang, Chengying
    Li, Jinbao
    Zhu, Jinghua
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (01):
  • [45] U-Shaped Wire Based Resonators for Mass Density and Viscosity Sensing
    Heinisch, Martin
    Reichel, Erwin K.
    Abdallah, Ali
    Clara, Stefan
    Jakoby, Bernhard
    Voglhuber-Brunnmaier, Thomas
    Dufour, Isabelle
    2015 IEEE SENSORS, 2015, : 1311 - 1314
  • [46] Travel distance and hotel service satisfaction: An inverted U-shaped relationship
    Park, Sangwon
    Yang, Yang
    Wang, Mingshu
    INTERNATIONAL JOURNAL OF HOSPITALITY MANAGEMENT, 2019, 76 : 261 - 270
  • [47] U-Shaped Dual Attention Vision Mamba Network for Satellite Remote Sensing Single-Image Dehazing
    Sui, Tangyu
    Xiang, Guangfeng
    Chen, Feinan
    Li, Yang
    Tao, Xiayu
    Zhou, Jiazu
    Hong, Jin
    Qiu, Zhenwei
    REMOTE SENSING, 2025, 17 (06)
  • [48] UMiT-Net: A U-Shaped Mix-Transformer Network for Extracting Precise Roads Using Remote Sensing Images
    Deng, Fei
    Luo, Wen
    Ni, Yudong
    Wang, Xuben
    Wang, Yan
    Zhang, Gulan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [49] The effect of design modifications on the torsional and compressive rigidity of U-shaped palatal major connectors
    Green, LK
    Hondrum, SO
    JOURNAL OF PROSTHETIC DENTISTRY, 2003, 89 (04): : 400 - 407
  • [50] Skin lesion image segmentation based on improved U-shaped network
    Zhao, Yuhang
    Yan, Tianxing
    Yilihamu, Yaermaimaiti
    INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2024, 8 (03) : 609 - 618