SCN: Self-Calibration Network for fast and accurate image super-resolution

被引:3
|
作者
Yang, Haoran [1 ]
Yang, Xiaomin [1 ]
Liu, Kai [2 ]
Jeon, Gwanggil [3 ]
Zhu, Ce [4 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Sichuan, Peoples R China
[2] Sichuan Univ, Coll Elect Engn, Chengdu 610065, Sichuan, Peoples R China
[3] Dept Embedded Syst Engn, Incheon 22012, South Korea
[4] Univ Elect Sci & Technol China, Sch Elect Engn, Chengdu, Peoples R China
关键词
Self-calibration network; Lightweight SR; Attention module fusion; Single image super-resolution (SISR);
D O I
10.1016/j.eswa.2023.120159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep and wide Convolutional neural networks (CNNs) achieve remarkable performance on image super -resolution (SR), while it is hard to be directly applied on edge devices due to the strict requirements on data transmission and processing. Therefore, numerous lightweight SR methods have been proposed. However, these methods often come with compromises on the reconstruction performance or speed due to the weak reconstruction supervision provided by shallow networks. Aiming to alleviate the above limitation, we introduce a self-calibration network (SCN) equipped with a hierarchical self-calibration module for fast and accurate image SR. Specially, we design a lightweight internal calibration module (ICM) to enable the network to economically focus on the key information by collaboratively refining the weights in both channel and spatial dimensions; and an efficient external calibration module (ECM) to focus on calibrating the prominent error of knowledge learned from the network on Low-Resolution (LR) data for saving computing resources. We experimentally demonstrate the synergy among the two modules guides to a superior SR performance against the state-of-the-art lightweight methods while requiring much fewer parameters and operations.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] TWO-STREAM SPARSE NETWORK FOR ACCURATE IMAGE SUPER-RESOLUTION
    Hu, Ling
    Wang, Shuhui
    Li, Liang
    Huang, Qingming
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 258 - 263
  • [22] Accurate Single Image Super-Resolution Using Deep Aggregation Network
    Chen, Xiaozhen
    Lu, Yao
    Wang, Xuebo
    Li, Weiqi
    Wang, Zijian
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 187 - 198
  • [23] LIGHTWEIGHT AND ACCURATE SINGLE IMAGE SUPER-RESOLUTION WITH CHANNEL SEGREGATION NETWORK
    Niu, Zhong-Han
    Lin, Xi-Peng
    Yu, An-Ni
    Zhou, Yang-Hao
    Yang, Yu-Bin
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1630 - 1634
  • [24] Accurate image registration for MAP image super-resolution
    Vrigkas, Michalis
    Nikou, Christophoros
    Kondi, Lisimachos P.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2013, 28 (05) : 494 - 508
  • [25] Feedback Network for Image Super-Resolution
    Li, Zhen
    Yang, Jinglei
    Liu, Zheng
    Yang, Xiaomin
    Jeon, Gwanggil
    Wu, Wei
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3862 - 3871
  • [26] Fast Single Image Super-Resolution by Self-trained Filtering
    Li, Dalong
    Simske, Steven
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS: WITH ASPECTS OF ARTIFICIAL INTELLIGENCE, 2012, 6839 : 469 - 475
  • [27] Iterative Network for Image Super-Resolution
    Liu, Yuqing
    Wang, Shiqi
    Zhang, Jian
    Wang, Shanshe
    Ma, Siwei
    Gao, Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2259 - 2272
  • [28] 3D dense convolutional neural network for fast and accurate single MR image super-resolution
    Wang, Lulu
    Du, Jinglong
    Gholipour, Ali
    Zhu, Huazheng
    He, Zhongshi
    Jia, Yuanyuan
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2021, 93
  • [29] Fast and accurate single image super-resolution via an energy-aware improved deep residual network
    Cao, Yanpeng
    He, Zewei
    Ye, Zhangyu
    Li, Xin
    Cao, Yanlong
    Yang, Jiangxin
    SIGNAL PROCESSING, 2019, 162 : 115 - 125
  • [30] Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations
    Umer, Rao Muhammad
    Foresti, Gian Luca
    Micheloni, Christian
    ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2019,