Efficient deep neural network for photo-realistic image super-resolution

被引:18
|
作者
Ahn, Namhyuk [1 ,2 ]
Kang, Byungkon [3 ]
Sohn, Kyung-Ah [2 ]
机构
[1] NAVER WEBTOON AI, Seoul, South Korea
[2] Ajou Univ, Dept Artificial Intelligence, Suwon, South Korea
[3] SUNY, Dept Comp Sci, Incheon, South Korea
关键词
Super-resolution; Photo-realistic; Convolutional neural network; Efficient model; Adversarial learning; Multi-scale approach;
D O I
10.1016/j.patcog.2022.108649
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent progress in deep learning-based models has improved photo-realistic (or perceptual) single-image super-resolution significantly. However, despite their powerful performance, many methods are difficult to apply to real-world applications because of the heavy computational requirements. To facilitate the use of a deep model under such demands, we focus on keeping the network efficient while maintaining its performance. In detail, we design an architecture that implements a cascading mechanism on a residual network to boost the performance with limited resources via multi-level feature fusion. In addition, our proposed model adopts group convolution and recursive schemes in order to achieve extreme efficiency. We further improve the perceptual quality of the output by employing the adversarial learning paradigm and a multi-scale discriminator approach. The performance of our method is investigated through extensive internal experiments and benchmarks using various datasets. Our results show that our models outperform the recent methods with similar complexity, for both traditional pixel-based and perception-based tasks. (C) 2022 The Authors. Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Orientation-aware Deep Neural Network for Real Image Super-Resolution
    Chen Du
    He Zewei
    Sun Anshun
    Yang Jiangxin
    Cao Yanlong
    Cao Yanpeng
    Tang Siliang
    Yang, Michael Ying
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1944 - 1953
  • [22] GUIDED CYCLEGAN VIA SEMI-DUAL OPTIMAL TRANSPORT FOR PHOTO-REALISTIC FACE SUPER-RESOLUTION
    Zheng, Wenbo
    Yan, Lan
    Zhang, Wenwen
    Gou, Chao
    Wang, Fei-Yue
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2851 - 2855
  • [23] Efficient document-image super-resolution using convolutional neural network
    Ram Krishna Pandey
    A G Ramakrishnan
    Sādhanā, 2018, 43
  • [24] Efficient document-image super-resolution using convolutional neural network
    Pandey, Ram Krishna
    Ramakrishnan, A. G.
    SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 2018, 43 (02):
  • [25] Deep Depth Super-Resolution: Learning Depth Super-Resolution Using Deep Convolutional Neural Network
    Song, Xibin
    Dai, Yuchao
    Qin, Xueying
    COMPUTER VISION - ACCV 2016, PT IV, 2017, 10114 : 360 - 376
  • [26] IMAGE SUPER-RESOLUTION VIA DEEP AGGREGATION NETWORK
    Wang, Xinya
    Ma, Jiayi
    Jiang, Junjun
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1747 - 1751
  • [27] Image super-resolution via deep residual network
    Duan, Yakang
    Luo, Lin
    Zhang, Yu
    Zhu, Hongna
    ELEVENTH INTERNATIONAL CONFERENCE ON INFORMATION OPTICS AND PHOTONICS (CIOP 2019), 2019, 11209
  • [28] A DEEP CONVOLUTIONAL NETWORK FOR MEDICAL IMAGE SUPER-RESOLUTION
    Gao, Yunxing
    Li, Hengjian
    Dong, Jiwen
    Feng, Guang
    2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 5310 - 5315
  • [29] Deep Unfolding Network for Spatiospectral Image Super-Resolution
    Ma, Qing
    Jiang, Junjun
    Liu, Xianming
    Ma, Jiayi
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 28 - 40
  • [30] Deep Recursive Network for Hyperspectral Image Super-Resolution
    Wei, Wei
    Nie, Jiangtao
    Li, Yong
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 (06) : 1233 - 1244