Enhanced implicit function-based network for arbitrary-scale image super-resolution

被引:0
|
作者
Wen, Caizhen [1 ]
Yang, Zhijing [1 ]
Shi, Yukai [1 ]
Qing, Chunmei [2 ]
Cheng, Yongqiang [3 ]
机构
[1] Guangdong Univ Technol, Sch Informat Engn, Guangzhou, Peoples R China
[2] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
[3] Univ Hull, Dept Comp Sci & Technol, Kingston Upon Hull, N Humberside, England
基金
中国国家自然科学基金;
关键词
arbitrary-scale image super-resolution; local-global encoder; enhanced implicit image function; neural network;
D O I
10.1117/1.JEI.31.4.043015
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the great development of deep learning, the performance of single image super-resolution (SR) has achieved tremendous progress. As an emerging and promising branch of the SR task, the arbitrary-scale SR task is receiving increasing attention from researchers due to its efficiency and practicality. Although the recent work learning implicit image function opened a solution for arbitrary-scale image SR, its reconstructed images contained structural distortions caused by defective prediction of high-frequency textures. To overcome this problem and further improve the performance of arbitrary-scale image SR, we propose an effective arbitrary-scale SR network, namely, enhanced arbitrary-scale super-resolution, which achieves the arbitrary-scale SR task in a single model by introducing a local-global encoder and enhanced implicit image function. Unlike conventional SR methods, which only stack up convolutional blocks to extract the local feature, the local-global encoder has two branches in parallel, including the local feature branch and the global prior branch. The former effectively extracts the local feature from a low-resolution image and the latter extracts the global prior to assist in the high-resolution image reconstruction. Next, we redesigned an enhanced implicit image function in the form of a dual modulation multiplayer perceptron (MLP) by replacing the implicit image function with a vanilla MLP. Moreover, we introduce the spatial encoding to further reduce structural distortions of reconstructed images. Extensive experiments were conducted to evaluate the performance and demonstrate the superiority of our proposed model.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Jena, Swastik
    Panda, Saptarshi
    Balabantaray, Bunil Kumar
    Nayak, Rajashree
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2440 - 2444
  • [2] ADAPTIVE LOCAL IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Li, Hongwei
    Dai, Tao
    Li, Yiming
    Zou, Xueyi
    Xia, Shu-Tao
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4033 - 4037
  • [3] Enhanced dual branches network for arbitrary-scale image super-resolution
    Li, Guangping
    Xiao, Huanling
    Liang, Dingkai
    [J]. ELECTRONICS LETTERS, 2023, 59 (01)
  • [4] Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution
    Yao, Jie-En
    Tsao, Li-Yuan
    Lo, Yi-Chen
    Tseng, Roy
    Chang, Chia-Che
    Lee, Chun-Yi
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1776 - 1785
  • [5] CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolution
    Cao, Jiezhang
    Wang, Qin
    Xian, Yongqin
    Li, Yawei
    Ni, Bingbing
    Pi, Zhiming
    Zhang, Kai
    Zhang, Yulun
    Timofte, Radu
    Van Gool, Luc
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1796 - 1807
  • [6] Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution
    Chen, Hao-Wei
    Xu, Yu-Syuan
    Hong, Min-Fong
    Tsai, Yi-Min
    Kuo, Hsien-Kai
    Lee, Chun-Yi
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18257 - 18267
  • [7] Arbitrary-Scale Image Super-Resolution via Degradation Perception
    Wan, Wenbo
    Wang, Zezhu
    Wang, Zhiyan
    Gu, Lingchen
    Sun, Jiande
    Wang, Qiang
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 666 - 676
  • [8] Activating More Information in Arbitrary-Scale Image Super-Resolution
    Zhao, Yaoqian
    Teng, Qizhi
    Chen, Honggang
    Zhang, Shujiang
    He, Xiaohai
    Li, Yi
    Sheriff, Ray E.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7946 - 7961
  • [9] An Image Arbitrary-Scale Super-Resolution Network Using Frequency-domain Information
    Fang, Jing
    Yu, Yinbo
    Wang, Zhongyuan
    Ding, Xin
    Hu, Ruimin
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (03)
  • [10] DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-Resolution
    Li, Guangyuan
    Xing, Wei
    Zhao, Lei
    Lan, Zehua
    Zhang, Zhanjie
    Sun, Jiakai
    Yin, Haolin
    Lin, Huaizhong
    Lin, Zhijie
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7335 - 7344