Deformable and residual convolutional network for image super-resolution

被引:12
|
作者
Zhang, Yan [1 ]
Sun, Yemei [1 ]
Liu, Shudong [1 ]
机构
[1] Tianjin Chengjian Univ, Sch Comp & Informat Engn, Tianjin, Peoples R China
关键词
Super-resolution; Deformable convolution; Residual connection; Convolutional neural network; Vanishing gradient; OBJECT DETECTION; ATTENTION;
D O I
10.1007/s10489-021-02246-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent research on image super-resolution (SR) has greatly progressed with the development of convolutional neural networks (CNNs). However, the fixed geometric structures of standard convolution filters largely limit the learning capacity of CNNs for image SR. To effectively address this problem, we propose a deformable and residual convolutional network (DefRCN) for image SR. Specifically, a deformable residual convolution block (DRCB) is developed to augment spatial sampling locations and enhance the transformation modelling capability of CNNs. In addition, we optimize the residual convolution block to reduce the model redundancy and alleviate the vanishing-gradient in backpropagation. In addition, the proposed upsample block allows the network to directly process low-resolution images, which reduces the computational resource cost. Extensive experiments on benchmark datasets verify that the proposed method achieves a high quantitative and qualitative performance.
引用
收藏
页码:295 / 304
页数:10
相关论文
共 50 条
  • [1] Deformable and residual convolutional network for image super-resolution
    Yan Zhang
    Yemei Sun
    Shudong Liu
    [J]. Applied Intelligence, 2022, 52 : 295 - 304
  • [2] Image Super-Resolution Using Residual Convolutional Neural Network
    Lee, Pei-Ying
    Tseng, Chien-Cheng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [3] A residual convolutional neural network for polarimetric SAR image super-resolution
    Shen, Huanfeng
    Lin, Liupeng
    Li, Jie
    Yuan, Qiangqiang
    Zhao, Lingli
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 161 : 90 - 108
  • [4] Deep Residual Convolutional Neural Network for Hyperspectral Image Super-Resolution
    Wang, Chen
    Liu, Yun
    Bai, Xiao
    Tang, Wenzhong
    Lei, Peng
    Zhou, Jun
    [J]. IMAGE AND GRAPHICS (ICIG 2017), PT III, 2017, 10668 : 370 - 380
  • [5] Deep Iterative Residual Convolutional Network for Single Image Super-Resolution
    Umer, Rao M.
    Foresti, G. L.
    Micheloni, C.
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1852 - 1858
  • [6] DSTnet: Deformable Spatio-Temporal Convolutional Residual Network for Video Super-Resolution
    Khan, Anusha
    Sargano, Allah Bux
    Habib, Zulfiqar
    [J]. MATHEMATICS, 2021, 9 (22)
  • [7] Image super-resolution reconstruction based on residual connection convolutional neural network
    Guo, Ji-Chang
    Wu, Jie
    Guo, Chun-Le
    Zhu, Ming-Hui
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2019, 49 (05): : 1726 - 1734
  • [8] A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network
    Liu Chengming
    Duan Junyi
    Pang Haibo
    [J]. Pattern Recognition and Image Analysis, 2021, 31 : 1 - 6
  • [9] A Single Image Super-Resolution Algorithm Based on Dense Residual Convolutional Network
    Chengming, Liu
    Junyi, Duan
    Haibo, Pang
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, 2021, 31 (01) : 1 - 6
  • [10] Residual Dense Network for Image Super-Resolution
    Zhang, Yulun
    Tian, Yapeng
    Kong, Yu
    Zhong, Bineng
    Fu, Yun
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2472 - 2481