Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolution

被引:30
|
作者
Yoo, Jinsu [1 ]
Kim, Taehoon [2 ]
Lee, Sihaeng [2 ]
Kim, Seung Hwan [2 ]
Lee, Honglak [2 ]
Kim, Tae Hyun [1 ]
机构
[1] Hanyang Univ, Seoul, South Korea
[2] LG AI Res, Seoul, South Korea
关键词
D O I
10.1109/WACV56688.2023.00493
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent transformer-based super-resolution (SR) methods have achieved promising results against conventional CNN-based methods. However, these approaches suffer from essential shortsightedness created by only utilizing the standard self-attention-based reasoning. In this paper, we introduce an effective hybrid SR network to aggregate enriched features, including local features from CNNs and long-range multi-scale dependencies captured by transformers. Specifically, our network comprises transformer and convolutional branches, which synergetically complement each representation during the restoration procedure. Furthermore, we propose a cross-scale token attention module, allowing the transformer branch to exploit the informative relationships among tokens across different scales efficiently. Our proposed method achieves state-of-the-art SR results on numerous benchmark datasets.
引用
收藏
页码:4945 / 4954
页数:10
相关论文
共 50 条
  • [21] A Lightweight CNN-Transformer Implemented via Structural Re-Parameterization and Hybrid Attention for Remote Sensing Image Super-Resolution
    Wang, Jie
    Li, Hongwei
    Li, Yifan
    Qin, Zilong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2025, 14 (01)
  • [22] Focal Aggregation Transformer for Light Field Image Super-Resolution
    Wang, Shunzhou
    Lu, Yao
    Xia, Wang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 524 - 538
  • [23] HCT: a hybrid CNN and transformer network for hyperspectral image super-resolution
    Wu, Huapeng
    Wang, Chenyun
    Lu, Chenyang
    Zhan, Tianming
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [24] TCSR: Lightweight Transformer and CNN Interaction Network for Image Super-Resolution
    Cai, Danlin
    Tan, Wenwen
    Chen, Feiyang
    Lou, Xinchi
    Xiahou, Jianbin
    Zhu, Daxin
    Huang, Detian
    IEEE ACCESS, 2024, 12 : 174782 - 174795
  • [25] CNN–Transformer gated fusion network for medical image super-resolution
    Juanjuan Qin
    Jian Xiong
    Zhantu Liang
    Scientific Reports, 15 (1)
  • [26] HyFormer: Hybrid Grouping-Aggregation Transformer and Wide-Spanning CNN for Hyperspectral Image Super-Resolution
    Ji, Yantao
    Shi, Jingang
    Zhang, Yaping
    Yang, Haokun
    Zong, Yuan
    Xu, Ling
    REMOTE SENSING, 2023, 15 (17)
  • [27] Omni Aggregation Networks for Lightweight Image Super-Resolution
    Wang, Hang
    Chen, Xuanhong
    Ni, Bingbing
    Liu, Yutian
    Liu, Jinfan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22378 - 22387
  • [28] Local-global aggregation transformer for enhanced image super-resolution
    Wu, Yuxiang
    Wang, Xiaoyan
    Gao, Yuzhao
    Liu, Xiaoyan
    Dou, Yan
    DIGITAL SIGNAL PROCESSING, 2025, 161
  • [29] DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image
    Lin, Cong
    Mao, Xin
    Qiu, Chenghao
    Zou, Lilan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11117 - 11133
  • [30] Hybrid CNN-Transformer Feature Fusion for Single Image Deraining
    Chen, Xiang
    Pan, Jinshan
    Lu, Jiyang
    Fan, Zhentao
    Li, Hao
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 378 - 386