No-Reference Image Quality Assessment by Hallucinating Pristine Features

被引:10
|
作者
Chen, Baoliang [1 ]
Zhu, Lingyu [1 ]
Kong, Chenqi [1 ]
Zhu, Hanwei [1 ]
Wang, Shiqi [1 ]
Li, Zhu [2 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Kowloon Tong, Hong Kong, Peoples R China
[2] Univ Missouri, Dept Comp Sci & Elect Engn, Kansas City, MO 64110 USA
基金
中国国家自然科学基金;
关键词
Feature extraction; Distortion; Training; Task analysis; Distortion measurement; Predictive models; Image quality; Image quality assessment; no-reference; mutual learning; pseudo-reference feature; SCREEN CONTENT IMAGES; FREE-ENERGY PRINCIPLE; NEURAL-NETWORKS; STATISTICS;
D O I
10.1109/TIP.2022.3205770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination. The proposed quality assessment framework is rooted in the view that the perceptually meaningful features could be well exploited to characterize the visual quality, and the natural image statistical behaviors are exploited in an effort to deliver the accurate predictions. Herein, the PR features from the distorted images are learned by a mutual learning scheme with the pristine reference as the supervision, and the discriminative characteristics of PR features are further ensured with the triplet constraints. Given a distorted image for quality inference, the feature level disentanglement is performed with an invertible neural layer for final quality prediction, leading to the PR and the corresponding distortion features for comparison. The effectiveness of our proposed method is demonstrated on four popular IQA databases, and superior performance on cross-database evaluation also reveals the high generalization capability of our method. The implementation of our method is publicly available on https://github.com/Baoliang93/FPR.
引用
收藏
页码:6139 / 6151
页数:13
相关论文
共 50 条
  • [41] No-reference image quality assessment in contourlet domain
    Lu, Wen
    Zeng, Kai
    Tao, Dacheng
    Yuan, Yuan
    Gao, Xinbo
    [J]. NEUROCOMPUTING, 2010, 73 (4-6) : 784 - 794
  • [42] No-reference image quality assessment algorithms: A survey
    Kamble, Vipin
    Bhurchandi, K. M.
    [J]. OPTIK, 2015, 126 (11-12): : 1090 - 1097
  • [43] Domain Fingerprints for No-Reference Image Quality Assessment
    Xia, Weihao
    Yang, Yujiu
    Xue, Jing-Hao
    Xiao, Jing
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (04) : 1332 - 1341
  • [44] No-Reference face image assessment based on deep features
    Liu, Guirong
    Xu, Yi
    Lan, Jinpeng
    [J]. APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXIX, 2016, 9971
  • [45] An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis
    Mukesh Kumar Rohil
    Neetika Gupta
    Prakash Yadav
    [J]. Signal, Image and Video Processing, 2020, 14 : 205 - 213
  • [46] An improved model for no-reference image quality assessment and a no-reference video quality assessment model based on frame analysis
    Rohil, Mukesh Kumar
    Gupta, Neetika
    Yadav, Prakash
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (01) : 205 - 213
  • [47] No-Reference Image Quality Metric Based on Features Evaluation
    Alaql, Omar
    Ghazinour, Kambiz
    Lu, Cheng Chang
    [J]. 2017 IEEE 7TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE IEEE CCWC-2017, 2017,
  • [48] No-Reference Image Quality Assessment for Image Auto-Denoising
    Xiangfei Kong
    Qingxiong Yang
    [J]. International Journal of Computer Vision, 2018, 126 : 537 - 549
  • [49] No-Reference Stereo Image Quality Assessment Based on Image Fusion
    Huang Shuyu
    Sang Qingbing
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (07)
  • [50] No-Reference Stereoscopic Image Quality Assessment Based on Binocular Statistical Features and Machine Learning
    Xu, Peng
    Guo, Man
    Chen, Lei
    Hu, Weifeng
    Chen, Qingshan
    Li, Yujun
    [J]. COMPLEXITY, 2021, 2021