UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION

被引:0
|
作者
Jena, Swastik [1 ]
Panda, Saptarshi [2 ]
Balabantaray, Bunil Kumar [1 ]
Nayak, Rajashree [3 ]
机构
[1] Natl Inst Technol Meghalaya, Dept Comp Sci & Engn, Shillong, Meghalaya, India
[2] Natl Inst Technol Meghalaya, Dept Civil Engn, Shillong, Meghalaya, India
[3] JIS Inst Adv Studies & Res, Ctr Data Sci, Kolkata, India
关键词
SISR; INR; Self-supervised learning; Model uncertainty;
D O I
10.1109/ICIP49359.2023.10222673
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The most integral step in computer vision and image processing tasks is the representation of images. Recently, continuous image parameterization using Implicit Neural Representations (INR) has shown a great advantage over discrete representations due to their spatial invariance. This property immediately finds application in the context of single-image super-resolution (SISR) at an arbitrary scale. However, most super-resolution models, including the INR-based Local Implicit Image Function (LIIF), produce only a single output, failing to address the ill-posedness of SISR. Moreover, these models tend to optimize a mean-squared-error (MSE) based loss function which causes blurring and structural distortion in regions exhibiting a high degree of variance (details). Our work proposes a novel uncertainty-aware self-supervised methodology (U-LIIF) that extends on LIIF, to reduce the blurriness and deals with the ill-posedness of SISR. Our U-LIIF does not require any re-training and yields diversified high-resolution images by leveraging model uncertainty. The efficacy of the proposed method is validated by substantial experiments on various benchmark datasets.
引用
收藏
页码:2440 / 2444
页数:5
相关论文
共 50 条
  • [1] ADAPTIVE LOCAL IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Li, Hongwei
    Dai, Tao
    Li, Yiming
    Zou, Xueyi
    Xia, Shu-Tao
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4033 - 4037
  • [2] Enhanced implicit function-based network for arbitrary-scale image super-resolution
    Wen, Caizhen
    Yang, Zhijing
    Shi, Yukai
    Qing, Chunmei
    Cheng, Yongqiang
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [3] Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution
    Yao, Jie-En
    Tsao, Li-Yuan
    Lo, Yi-Chen
    Tseng, Roy
    Chang, Chia-Che
    Lee, Chun-Yi
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1776 - 1785
  • [4] Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution
    Chen, Hao-Wei
    Xu, Yu-Syuan
    Hong, Min-Fong
    Tsai, Yi-Min
    Kuo, Hsien-Kai
    Lee, Chun-Yi
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18257 - 18267
  • [5] Arbitrary-Scale Image Super-Resolution via Degradation Perception
    Wan, Wenbo
    Wang, Zezhu
    Wang, Zhiyan
    Gu, Lingchen
    Sun, Jiande
    Wang, Qiang
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 666 - 676
  • [6] Activating More Information in Arbitrary-Scale Image Super-Resolution
    Zhao, Yaoqian
    Teng, Qizhi
    Chen, Honggang
    Zhang, Shujiang
    He, Xiaohai
    Li, Yi
    Sheriff, Ray E.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7946 - 7961
  • [7] CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolution
    Cao, Jiezhang
    Wang, Qin
    Xian, Yongqin
    Li, Yawei
    Ni, Bingbing
    Pi, Zhiming
    Zhang, Kai
    Zhang, Yulun
    Timofte, Radu
    Van Gool, Luc
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1796 - 1807
  • [8] Synergizing frequency domain and texture-aware implicit module for MRI arbitrary-scale super-resolution
    Tu, Xinyue
    Li, Guangyuan
    Liu, Yuanxing
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 98
  • [9] Enhanced dual branches network for arbitrary-scale image super-resolution
    Li, Guangping
    Xiao, Huanling
    Liang, Dingkai
    [J]. ELECTRONICS LETTERS, 2023, 59 (01)
  • [10] Bidirectional scale-aware upsampling network for arbitrary-scale video super-resolution
    Luo, Laigan
    Yi, Benshun
    Wang, Zhongyuan
    He, Zheng
    Zhu, Chao
    [J]. IMAGE AND VISION COMPUTING, 2024, 148