HDIQA: A Hyper Debiasing Framework for Full Reference Image Quality Assessment

被引:6
|
作者
Zhou, Mingliang [1 ]
Wang, Heqiang [1 ]
Wei, Xuekai [1 ]
Feng, Yong [1 ]
Luo, Jun [2 ]
Pu, Huayan [2 ]
Zhao, Jinglei [2 ]
Wang, Liming [2 ]
Chu, Zhigang [2 ]
Wang, Xin [2 ,3 ]
Fang, Bin [1 ]
Shang, Zhaowei [1 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Sch Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Prod Dept, Chongqing 400020, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image quality; Visualization; Tensors; Task analysis; Perturbation methods; Quality assessment; Image quality assessment; deep feature; hypernetwork; Tucker decomposition; SIMILARITY; VISIBILITY;
D O I
10.1109/TBC.2024.3353573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent methods that project images into deep feature spaces to evaluate quality degradation have produced inefficient results due to biased mappings; i.e., these projections are not aligned with the perceptions of humans. In this paper, we develop a hyperdebiasing framework to address such bias in full-reference image quality assessment. First, we perform orthogonal Tucker decomposition on the top of feature tensors extracted by a feature extraction network to project features into a robust content-agnostic space and effectively eliminate the bias caused by subtle image perturbations. Second, we propose a hypernetwork in which the content-aware parameters are produced for reprojecting features in a deep subspace for quality prediction. By leveraging the content diversity of large-scale blind-reference datasets, the perception rule between image content and image quality is established. Third, a quality prediction network is proposed by combining debiased content-aware and content-agnostic features to predict the final image quality score. To demonstrate the efficacy of our proposed method, we conducted numerous experiments on comprehensive databases. The experimental results validate that our method achieves state-of-the-art performance in predicting image quality.
引用
收藏
页码:545 / 554
页数:10
相关论文
共 50 条
  • [31] Misalignment Insensitive Perceptual Metric for Full Reference Image Quality Assessment
    Yao, Shunyu
    Cao, Yue
    Zhang, Yabo
    Zuo, Wangmeng
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 444 - 456
  • [32] New Combined Metric for Full-Reference Image Quality Assessment
    Frackiewicz, Mariusz
    Machalica, Lukasz
    Palus, Henryk
    SYMMETRY-BASEL, 2024, 16 (12):
  • [33] Full Reference Image Quality Assessment Based on Saliency Map Analysis
    Tong, Yubing
    Konik, Hubert
    Cheikh, Faouzi A.
    Tremeau, Alain
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2010, 54 (03)
  • [34] Full-reference image quality assessment based on image segmentation with edge feature
    Shi, Zaifeng
    Zhang, Jiaping
    Cao, Qingjie
    Pang, Ke
    Luo, Tao
    SIGNAL PROCESSING, 2018, 145 : 99 - 105
  • [35] Framework for Applying Full Reference Digital Image Quality Measures to Printed Images
    Eerola, Tuomas
    Kamarainen, Joni-Kristian
    Lensu, Lasse
    Kalviainen, Heikki
    IMAGE ANALYSIS, PROCEEDINGS, 2009, 5575 : 99 - +
  • [36] Unsupervised Feature Learning Framework for No-reference Image Quality Assessment
    Ye, Peng
    Kumar, Jayant
    Kang, Le
    Doermann, David
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 1098 - 1105
  • [37] A Non-Parametric Framework for No-Reference Image Quality Assessment
    Manap, Redzuan Abdul
    Frangi, Alejandro F.
    Shao, Ling
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 562 - 566
  • [38] Deep Ordinal Regression Framework for No-Reference Image Quality Assessment
    Wang, Huasheng
    Tu, Yulin
    Liu, Xiaochang
    Tan, Hongchen
    Liu, Hantao
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 428 - 432
  • [39] Hybrid Feature Similarity Approach to Full-Reference Image Quality Assessment
    Okarma, Krzysztof
    COMPUTER VISION AND GRAPHICS, 2012, 7594 : 212 - 219
  • [40] RVSIM: a feature similarity method for full-reference image quality assessment
    Guangyi Yang
    Deshi Li
    Fan Lu
    Yue Liao
    Wen Yang
    EURASIP Journal on Image and Video Processing, 2018