No-Reference Image Quality Assessment by Hallucinating Pristine Features

被引:10
|
作者
Chen, Baoliang [1 ]
Zhu, Lingyu [1 ]
Kong, Chenqi [1 ]
Zhu, Hanwei [1 ]
Wang, Shiqi [1 ]
Li, Zhu [2 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Kowloon Tong, Hong Kong, Peoples R China
[2] Univ Missouri, Dept Comp Sci & Elect Engn, Kansas City, MO 64110 USA
基金
中国国家自然科学基金;
关键词
Feature extraction; Distortion; Training; Task analysis; Distortion measurement; Predictive models; Image quality; Image quality assessment; no-reference; mutual learning; pseudo-reference feature; SCREEN CONTENT IMAGES; FREE-ENERGY PRINCIPLE; NEURAL-NETWORKS; STATISTICS;
D O I
10.1109/TIP.2022.3205770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination. The proposed quality assessment framework is rooted in the view that the perceptually meaningful features could be well exploited to characterize the visual quality, and the natural image statistical behaviors are exploited in an effort to deliver the accurate predictions. Herein, the PR features from the distorted images are learned by a mutual learning scheme with the pristine reference as the supervision, and the discriminative characteristics of PR features are further ensured with the triplet constraints. Given a distorted image for quality inference, the feature level disentanglement is performed with an invertible neural layer for final quality prediction, leading to the PR and the corresponding distortion features for comparison. The effectiveness of our proposed method is demonstrated on four popular IQA databases, and superior performance on cross-database evaluation also reveals the high generalization capability of our method. The implementation of our method is publicly available on https://github.com/Baoliang93/FPR.
引用
收藏
页码:6139 / 6151
页数:13
相关论文
共 50 条
  • [1] No-Reference Image Quality Assessment with Global Statistical Features
    Varga, Domonkos
    [J]. JOURNAL OF IMAGING, 2021, 7 (02)
  • [2] Hybrid NSS features for no-reference image quality assessment
    Qin, Min
    Lv, Xiaoxin
    Chen, Xiaohui
    Wang, Weidong
    [J]. IET IMAGE PROCESSING, 2017, 11 (06) : 443 - 449
  • [3] A No-Reference Image Quality Assessment
    Kemalkar, Aniket K.
    Bairagi, Vinayak K.
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN COMPUTING, COMMUNICATION AND NANOTECHNOLOGY (ICE-CCN'13), 2013, : 462 - 465
  • [4] No-reference image quality assessment based on gradient domain features
    Yao, C.
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2018, 123 : 72 - 72
  • [5] No-Reference Image Quality Assessment Using the Statistics of Global and Local Image Features
    Varga, Domonkos
    [J]. ELECTRONICS, 2023, 12 (07)
  • [6] No-Reference Stereoscopic Image Quality Assessment
    Akhter, Roushain
    Sazzad, Z. M. Parvez
    Horita, Y.
    Baltes, J.
    [J]. STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
  • [7] No-reference Image Denoising Quality Assessment
    Lu, Si
    [J]. ADVANCES IN COMPUTER VISION, CVC, VOL 1, 2020, 943 : 416 - 433
  • [8] Automatic no-reference image quality assessment
    Li, Hongjun
    Hu, Wei
    Xu, Zi-neng
    [J]. SPRINGERPLUS, 2016, 5
  • [9] No-Reference Image Quality Assessment Based on the Fusion of Statistical and Perceptual Features
    Varga, Domonkos
    [J]. JOURNAL OF IMAGING, 2020, 6 (08)
  • [10] No-Reference Fingerprint Image Quality Assessment
    Tiwari, Kamlesh
    Gupta, Phalguni
    [J]. INTELLIGENT COMPUTING METHODOLOGIES, 2014, 8589 : 846 - 854