COUPLING SPATIAL AND CHANNEL TRANSFORMER FOR SINGLE IMAGE DERAINING

被引:0
|
作者
Namba, Yuto [1 ]
Sun, Jiande [2 ]
Han, Xian-Hua [1 ]
机构
[1] Yamaguchi Univ, Yamaguchi, Japan
[2] Shandong Normal Univ, Jinan, Peoples R China
关键词
Image deraining; transformer; self-attention;
D O I
10.1109/ICIP49359.2023.10222823
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image deraining is a fundamental low-level vision task, and has evolved remarkable progress with the deep learning technique. Recently, benefiting from the powerful modeling ability of long-range dependence, transformer as an alternative architecture of the dominant convolutional neural network has demonstrated large margin performance improvement in various high-level vision tasks, and has begun to be applied for low-level vision tasks. The benchmark transformer block captures long dependence via incorporating the self-attention among the spatial points of the learned feature map, and causes heavy computational workload and memory footprint quadratically increased with spatial resolutions, making it impossible to handle high-resolution images. This study proposes a novel spatial and channel coupled Transformer to jointly explore long-range dependence and correlation in both spatial and channel domains, and results in a lightweight deraining transformer model for potentially processing high-resolution images.
引用
收藏
页码:2080 / 2084
页数:5
相关论文
共 50 条
  • [1] Channel Pyramidal Transformer Network for Single Image Deraining
    Xu, Yifei
    Long, Zourong
    Tang, Bin
    Lei, Siyue
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1757 - 1761
  • [2] Multi-scale Channel Transformer Network for Single Image Deraining
    Namba, Yuto
    Han, Xian-Hua
    [J]. PROCEEDINGS OF THE 4TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA IN ASIA, MMASIA 2022, 2022,
  • [3] CTFCD: Channel transformer based on full convolutional decoder for single image deraining
    Tan, Shaohan
    Chen, Hui
    Zhu, Songhao
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 98
  • [4] Alternating attention Transformer for single image deraining
    Yang, Dawei
    He, Xin
    Zhang, Ruiheng
    [J]. DIGITAL SIGNAL PROCESSING, 2023, 141
  • [5] RainFormer: a pyramid transformer for single image deraining
    Yang, Hao
    Zhou, Dongming
    Cao, Jinde
    Zhao, Qian
    Li, Miao
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (06): : 6115 - 6140
  • [6] RainFormer: a pyramid transformer for single image deraining
    Hao Yang
    Dongming Zhou
    Jinde Cao
    Qian Zhao
    Miao Li
    [J]. The Journal of Supercomputing, 2023, 79 : 6115 - 6140
  • [7] Spatial-guided informative semantic joint transformer for single-image deraining
    Haiyan Li
    Shaolin Peng
    Xun Lang
    Shuhua Ye
    Hongsong Li
    [J]. The Journal of Supercomputing, 2024, 80 : 6522 - 6551
  • [8] Spatial-guided informative semantic joint transformer for single-image deraining
    Li, Haiyan
    Peng, Shaolin
    Lang, Xun
    Ye, Shuhua
    Li, Hongsong
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (05): : 6522 - 6551
  • [9] A Single Image Deraining Algorithm Based on Swin Transformer
    Gao, Tao
    Wen, Yuanbo
    Chen, Ting
    Zhang, Jing
    [J]. Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2023, 57 (05): : 613 - 623
  • [10] Degradation-Aware Transformer for Single Image Deraining
    Zhao, Peijun
    Wang, Tongjun
    [J]. IEEE ACCESS, 2023, 11 : 97274 - 97283