Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution

被引:30
|
作者
Yoo, Jinsu [1 ]
Kim, Taehoon [2 ]
Lee, Sihaeng [2 ]
Kim, Seung Hwan [2 ]
Lee, Honglak [2 ]
Kim, Tae Hyun [1 ]
机构
[1] Hanyang Univ, Seoul, South Korea
[2] LG AI Res, Seoul, South Korea
关键词
D O I
10.1109/WACV56688.2023.00493
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent transformer-based super-resolution (SR) methods have achieved promising results against conventional CNN-based methods. However, these approaches suffer from essential shortsightedness created by only utilizing the standard self-attention-based reasoning. In this paper, we introduce an effective hybrid SR network to aggregate enriched features, including local features from CNNs and long-range multi-scale dependencies captured by transformers. Specifically, our network comprises transformer and convolutional branches, which synergetically complement each representation during the restoration procedure. Furthermore, we propose a cross-scale token attention module, allowing the transformer branch to exploit the informative relationships among tokens across different scales efficiently. Our proposed method achieves state-of-the-art SR results on numerous benchmark datasets.
引用
收藏
页码:4945 / 4954
页数:10
相关论文
共 50 条
  • [1] An Amalgamated CNN-Transformer Network for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Zeng, Kun
    Journal of Network Intelligence, 2024, 9 (03): : 1376 - 1387
  • [2] A Decoder Structure Guided CNN-Transformer Network for face super-resolution
    Dou, Rui
    Li, Jiawen
    Wan, Xujie
    Chang, Heyou
    Zheng, Hao
    Gao, Guangwei
    IET COMPUTER VISION, 2024, 18 (04) : 473 - 484
  • [3] Efficiently Amalgamated CNN-Transformer Network for Image Super-Resolution Reconstruction
    Zheng, Mengyuan
    Zang, Huaijuan
    Liu, Xinzhi
    Cheng, Guoan
    Zhan, Shu
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 3 - 13
  • [4] An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution
    Zhang, Wenjian
    Tan, Zheng
    Lv, Qunbo
    Li, Jiaao
    Zhu, Baoyu
    Liu, Yangyang
    REMOTE SENSING, 2024, 16 (05)
  • [5] CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution
    Gao, Guangwei
    Xu, Zixiang
    Li, Juncheng
    Yang, Jian
    Zeng, Tieyong
    Qi, Guo-Jun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1978 - 1991
  • [6] A CNN-Transformer Embedded Unfolding Network for Hyperspectral Image Super-Resolution
    Tang, Yao
    Li, Jie
    Yue, Linwei
    Liu, Xinxin
    Li, Yajie
    Xiao, Yi
    Yuan, Qiangqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [7] Image Super-Resolution Reconstruction Method Based on Lightweight Symmetric CNN-Transformer
    Wang, Tingwei
    Zhao, Jianwei
    Zhou, Zhenghua
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (07): : 626 - 637
  • [8] SCTANet: A Spatial Attention-Guided CNN-Transformer Aggregation Network for Deep Face Image Super-Resolution
    Bao, Qiqi
    Liu, Yunmeng
    Gang, Bowen
    Yang, Wenming
    Liao, Qingmin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8554 - 8565
  • [9] A lightweight distillation CNN-transformer architecture for remote sensing image super-resolution
    Wang, Yu
    Shao, Zhenfeng
    Lu, Tao
    Liu, Lifeng
    Huang, Xiao
    Wang, Jiaming
    Jiang, Kui
    Zeng, Kangli
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) : 3560 - 3579
  • [10] A CNN-transformer hybrid network with selective fusion and dual attention for image super-resolution
    Zhang, Chun
    Wang, Jin
    Shi, Yunhui
    Yin, Baocai
    Ling, Nam
    MULTIMEDIA SYSTEMS, 2025, 31 (02)