Dual-Channel Residual Network for Image Super-Resolution Reconstruction

被引:0
|
作者
Zuo L. [1 ]
Zhang P. [2 ]
Jing S. [1 ]
Zhao Y. [1 ]
Li F. [3 ]
机构
[1] School of Information Engineering, Chang'an University, Xi'an
[2] School of Telecommunications Engineering, Xidian University, Xi'an
[3] School of Information and Communications Engineering, Xi'an Jiaotong University, Xi'an
关键词
Adaptive structured convolution; Channel attention; Deep learning; Residual networks; Super-resolution reconstruction;
D O I
10.7652/xjtuxb202201018
中图分类号
学科分类号
摘要
Aiming at the shortcomings of the existing deep learning based image super-resolution algorithms in image high-frequency detail reconstruction, a dual-channel residual network emphasizing image high-frequency detail reconstruction is proposed. Residual structure with channel attention mechanism is leveraged as the main channel of the network. Targeting on retaining more delicate geometric structure and edge information of the original image during the reconstruction, the auxiliary channel of the network is designed by an adaptive structured convolution hence the evolved dual-channel residual network has a stronger ability to capture high-frequency information during the learning process. To make the reconstructed image well coincide with the subjective visual experience of human eye, L1 loss function is combined with the multi-scale structural similarity loss function to train the network, so that the network completely retains the visual effect of the image during the training process. Experiments on the benchmark database show that combining the auxiliary channel based on adaptive structured convolution outside the main channel can heighten the peak signal-to-noise ratio of the reconstructed image by 2 dB. The simultaneous operation of L1 loss function and the multi-scale structural similarity loss function can heighten the peak signal-to-noise ratio of the reconstructed image by 3 dB and the structural similarity by 0.05. The objective and quantitative comparison with the competing networks exhibits the proposed network's outstanding effectiveness on two public data sets. © 2022, Editorial Office of Journal of Xi'an Jiaotong University. All right reserved.
引用
收藏
页码:158 / 164
页数:6
相关论文
共 22 条
  • [1] ZHANG Zhe, QI Chun, ZHANG Zhaoqiang, Et al., A selection method of projection space for face super-resolution reconstruction, Journal of Xi'an Jiaotong University, 52, 8, pp. 43-48, (2018)
  • [2] SONG Changming, WANG Yun, Super resolution reconstruction algorithm combined low rank with sparse representation, Journal of Xi'an Jiaotong University, 52, 7, pp. 18-24, (2018)
  • [3] LI Yuhua, QI Chun, A super-resolution method for face images using position-dictionary pairs, Journal of Xi'an Jiaotong University, 46, 6, pp. 7-11, (2012)
  • [4] MA Xiang, QI Chun, A face image super-resolution algorithm based on global reconstruction and position-patch residue compensation, Journal of Xi'an Jiaotong University, 44, 4, pp. 9-12, (2010)
  • [5] FU Lihua, SUN Xiaowei, ZHAO Yu, Et al., Fast video super-resolution reconstruction method based on motion feature fusion, Pattern Recognition and Artificial Intelligence, 32, 11, pp. 1022-1031, (2019)
  • [6] LEDIG C, THEIS L, HUSZAR F, Et al., Photo-realistic single image super-resolution using a generative adversarial network, Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 105-114, (2017)
  • [7] SHI Wenzhe, CABALLERO J, LEDIG C, Et al., Cardiac image super-resolution with global correspondence using multi-atlas patchmatch, Proceedings of the 2013 Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 9-16, (2013)
  • [8] KIM J, LEE J K, LEE K M., Accurate image super-resolution using very deep convolutional networks, Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1646-1654, (2016)
  • [9] ZHANG Yulun, LI Kunpeng, LI Kai, Et al., Image super-resolution using very deep residual channel attention networks, Proceedings of the 2018 European Conference on Computer Vision (ECCV), pp. 294-310, (2018)
  • [10] DONG Chao, LOY C C, HE Kaiming, Et al., Learning a deep convolutional network for image super-resolution, Proceedings of the 2014 European Conference on Computer Vision (ECCV), pp. 184-199, (2014)