Efficient deep neural network for photo-realistic image super-resolution

被引:18
|
作者
Ahn, Namhyuk [1 ,2 ]
Kang, Byungkon [3 ]
Sohn, Kyung-Ah [2 ]
机构
[1] NAVER WEBTOON AI, Seoul, South Korea
[2] Ajou Univ, Dept Artificial Intelligence, Suwon, South Korea
[3] SUNY, Dept Comp Sci, Incheon, South Korea
关键词
Super-resolution; Photo-realistic; Convolutional neural network; Efficient model; Adversarial learning; Multi-scale approach;
D O I
10.1016/j.patcog.2022.108649
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent progress in deep learning-based models has improved photo-realistic (or perceptual) single-image super-resolution significantly. However, despite their powerful performance, many methods are difficult to apply to real-world applications because of the heavy computational requirements. To facilitate the use of a deep model under such demands, we focus on keeping the network efficient while maintaining its performance. In detail, we design an architecture that implements a cascading mechanism on a residual network to boost the performance with limited resources via multi-level feature fusion. In addition, our proposed model adopts group convolution and recursive schemes in order to achieve extreme efficiency. We further improve the perceptual quality of the output by employing the adversarial learning paradigm and a multi-scale discriminator approach. The performance of our method is investigated through extensive internal experiments and benchmarks using various datasets. Our results show that our models outperform the recent methods with similar complexity, for both traditional pixel-based and perception-based tasks. (C) 2022 The Authors. Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Super-resolution microscopy by grating and deep neural network
    Liu, Xingyu
    Zhang, Zongyan
    Yang, Songlin
    Jiang, Wenli
    Yu, Jiang
    Fang, Wenjing
    Zhang, Jia-Yu
    Ye, Yong-Hong
    Journal of Applied Physics, 2024, 136 (15)
  • [32] Image Fusion and Super-Resolution with Convolutional Neural Network
    Zhong, Jinying
    Yang, Bin
    Li, Yuehua
    Zhong, Fei
    Chen, Zhongze
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 78 - 88
  • [33] Image Super-Resolution Using Deep RCSA Network
    Cao, Yuheng
    Zhou, Mengjie
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT IV, 2022, 13532 : 695 - 706
  • [34] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [35] Deep Residual Network for Single Image Super-Resolution
    Wang, Haimin
    Liao, Kai
    Yan, Bin
    Ye, Run
    ICCCV 2019: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON CONTROL AND COMPUTER VISION, 2019, : 66 - 70
  • [36] Adaptive Residual Neural Network for Image Super-Resolution
    Li, Weiwei
    Li, Xinlong
    Liu, Zhenbing
    MIPPR 2019: PARALLEL PROCESSING OF IMAGES AND OPTIMIZATION TECHNIQUES; AND MEDICAL IMAGING, 2020, 11431
  • [37] Improved BP neural network for image super-resolution
    Zhu, Fu-Zhen
    Zhu, Bing
    Li, Pei-Hua
    Ding, Qun
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2014, 36 (06): : 1215 - 1219
  • [38] Convolutional Neural Network for Smoke Image Super-Resolution
    Liu, Maoshen
    Gu, Ke
    Qiao, Junfei
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2018), 2018,
  • [39] An efficient and lightweight image super-resolution with feature network
    Zang, Yongsheng
    Zhou, Dongming
    Wang, Changcheng
    Nie, Rencan
    Guo, Yanbu
    OPTIK, 2022, 255
  • [40] Deep Proton DoseNet: A Deep Neural Network for Proton Dose Distribution Image Super-Resolution
    Nomura, Y.
    Matsuura, T.
    Shirato, H.
    Shimizu, S.
    Xing, L.
    MEDICAL PHYSICS, 2020, 47 (06) : E598 - E598