Efficient deep neural network for photo-realistic image super-resolution

被引:18
|
作者
Ahn, Namhyuk [1 ,2 ]
Kang, Byungkon [3 ]
Sohn, Kyung-Ah [2 ]
机构
[1] NAVER WEBTOON AI, Seoul, South Korea
[2] Ajou Univ, Dept Artificial Intelligence, Suwon, South Korea
[3] SUNY, Dept Comp Sci, Incheon, South Korea
关键词
Super-resolution; Photo-realistic; Convolutional neural network; Efficient model; Adversarial learning; Multi-scale approach;
D O I
10.1016/j.patcog.2022.108649
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent progress in deep learning-based models has improved photo-realistic (or perceptual) single-image super-resolution significantly. However, despite their powerful performance, many methods are difficult to apply to real-world applications because of the heavy computational requirements. To facilitate the use of a deep model under such demands, we focus on keeping the network efficient while maintaining its performance. In detail, we design an architecture that implements a cascading mechanism on a residual network to boost the performance with limited resources via multi-level feature fusion. In addition, our proposed model adopts group convolution and recursive schemes in order to achieve extreme efficiency. We further improve the perceptual quality of the output by employing the adversarial learning paradigm and a multi-scale discriminator approach. The performance of our method is investigated through extensive internal experiments and benchmarks using various datasets. Our results show that our models outperform the recent methods with similar complexity, for both traditional pixel-based and perception-based tasks. (C) 2022 The Authors. Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
    Ledig, Christian
    Theis, Lucas
    Huszar, Ferenc
    Caballero, Jose
    Cunningham, Andrew
    Acosta, Alejandro
    Aitken, Andrew
    Tejani, Alykhan
    Totz, Johannes
    Wang, Zehan
    Shi, Wenzhe
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 105 - 114
  • [2] Photo-Realistic Image Super-Resolution via Variational Autoencoders
    Liu, Zhi-Song
    Siu, Wan-Chi
    Chan, Yui-Lam
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (04) : 1351 - 1365
  • [3] Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations
    Umer, Rao Muhammad
    Foresti, Gian Luca
    Micheloni, Christian
    [J]. ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2019,
  • [4] Normalizing Flow as a Flexible Fidelity Objective for Photo-Realistic Super-resolution
    Lugmayr, Andreas
    Danelljan, Martin
    Yu, Fisher
    Van Gool, Luc
    Timofte, Radu
    [J]. 2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 874 - 883
  • [5] Content-Aware Local GAN for Photo-Realistic Super-Resolution
    Park, JoonKyu
    Son, Sanghyun
    Lee, Kyoung Mu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 10551 - 10560
  • [6] Image Super-Resolution With Deep Convolutional Neural Network
    Ji, Xiancai
    Lu, Yao
    Guo, Li
    [J]. 2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE IN CYBERSPACE (DSC 2016), 2016, : 626 - 630
  • [7] GAN with Pixel and Perceptual Regularizations for Photo-Realistic Joint Deblurring and Super-Resolution
    Li, Yong
    Yang, Zhenguo
    Mao, Xudong
    Wang, Yong
    Li, Qing
    Liu, Wenyin
    Wang, Ying
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2019, 2019, 11542 : 395 - 401
  • [8] A Compact Deep Neural Network for Single Image Super-Resolution
    Xu, Xiaoyu
    Qian, Jian
    Yu, Li
    Yu, Shengju
    HaoTao
    Zhu, Ran
    [J]. MULTIMEDIA MODELING (MMM 2020), PT II, 2020, 11962 : 148 - 160
  • [9] SuperNet: An Efficient Image Super-Resolution Preserving Neural Network
    Jayachitra, V. P.
    Devi, P. Renuka
    Nandhini, S.
    Khan, S. Darvish
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC 2019), 2019, : 420 - 427
  • [10] Deep Residual Convolutional Neural Network for Hyperspectral Image Super-Resolution
    Wang, Chen
    Liu, Yun
    Bai, Xiao
    Tang, Wenzhong
    Lei, Peng
    Zhou, Jun
    [J]. IMAGE AND GRAPHICS (ICIG 2017), PT III, 2017, 10668 : 370 - 380