Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

被引:0
|
作者
Zhang, Kuiyuan [1 ]
Hua, Zhongyun [1 ]
Li, Yuanman [2 ,3 ]
Zhang, Yushu [4 ]
Zhou, Yicong [5 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Guangdong, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen 518055, Guangdong, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Transformers; Task analysis; Computer architecture; Image coding; Iterative methods; Extraterrestrial measurements; Compressive sensing service; compressive sampling; image reconstruction; adaptive sampling; deep learning; RECONSTRUCTION; ALGORITHMS;
D O I
10.1109/TSC.2023.3334446
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.
引用
收藏
页码:2974 / 2988
页数:15
相关论文
共 50 条
  • [11] GUFORMER: a gradient-aware U-shaped transformer neural network for real image denoising
    Bai, Xuefei
    Wan, Yongsong
    Wang, Weiming
    Zhou, Bin
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):
  • [12] Permutation invariant self-attention infused U-shaped transformer for medical image segmentation
    Patil, Sanjeet S.
    Ramteke, Manojkumar
    Rathore, Anurag S.
    NEUROCOMPUTING, 2025, 625
  • [13] Remote Sensing Image Segmentation Based on U-shaped Network with Atrous Spatial Pyramid
    Hou, Yunlong
    Zhu, Lei
    Chen, Qin
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7335 - 7339
  • [14] RockFormer: A U-Shaped Transformer Network for Martian Rock Segmentation
    Liu, Haiqiang
    Yao, Meibao
    Xiao, Xueming
    Xiong, Yonggang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [15] U-shaped stacked structure monolithic transformer for efficiency improvement
    Kang, Sungyoon
    Kim, Minchul
    Kim, Junghyun
    MICROWAVE AND OPTICAL TECHNOLOGY LETTERS, 2018, 60 (09) : 2325 - 2330
  • [16] A hybrid U-shaped and transformer network for change detection in high-resolution remote sensing images
    Wu, Huapeng
    Yuan, Mengxue
    Zhan, Tianming
    IET IMAGE PROCESSING, 2024, 18 (05) : 1373 - 1384
  • [17] A U-shaped wire for viscosity and mass density sensing
    Heinisch, M.
    Reichel, E. K.
    Dufour, I.
    Jakoby, B.
    SENSORS AND ACTUATORS A-PHYSICAL, 2014, 214 : 245 - 251
  • [18] Internal resonance of a U-shaped microresonator for gas sensing
    Lenz, Wagner B.
    Rocha, Rodrigo T.
    Khan, Fahimullah
    Grande, Carlos A.
    Younis, Mohammad I.
    NONLINEAR DYNAMICS, 2025, 113 (08) : 7677 - 7689
  • [19] D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
    Wu, Yixuan
    Liao, Kuanlun
    Chen, Jintai
    Wang, Jinhong
    Chen, Danny Z.
    Gao, Honghao
    Wu, Jian
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (02): : 1931 - 1944
  • [20] D-former: a U-shaped Dilated Transformer for 3D medical image segmentation
    Yixuan Wu
    Kuanlun Liao
    Jintai Chen
    Jinhong Wang
    Danny Z. Chen
    Honghao Gao
    Jian Wu
    Neural Computing and Applications, 2023, 35 : 1931 - 1944