HDIQA: A Hyper Debiasing Framework for Full Reference Image Quality Assessment

被引:6
|
作者
Zhou, Mingliang [1 ]
Wang, Heqiang [1 ]
Wei, Xuekai [1 ]
Feng, Yong [1 ]
Luo, Jun [2 ]
Pu, Huayan [2 ]
Zhao, Jinglei [2 ]
Wang, Liming [2 ]
Chu, Zhigang [2 ]
Wang, Xin [2 ,3 ]
Fang, Bin [1 ]
Shang, Zhaowei [1 ]
机构
[1] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Sch Mech & Vehicle Engn, Chongqing 400044, Peoples R China
[3] Chongqing Changan Automobile Co Ltd, Prod Dept, Chongqing 400020, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image quality; Visualization; Tensors; Task analysis; Perturbation methods; Quality assessment; Image quality assessment; deep feature; hypernetwork; Tucker decomposition; SIMILARITY; VISIBILITY;
D O I
10.1109/TBC.2024.3353573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent methods that project images into deep feature spaces to evaluate quality degradation have produced inefficient results due to biased mappings; i.e., these projections are not aligned with the perceptions of humans. In this paper, we develop a hyperdebiasing framework to address such bias in full-reference image quality assessment. First, we perform orthogonal Tucker decomposition on the top of feature tensors extracted by a feature extraction network to project features into a robust content-agnostic space and effectively eliminate the bias caused by subtle image perturbations. Second, we propose a hypernetwork in which the content-aware parameters are produced for reprojecting features in a deep subspace for quality prediction. By leveraging the content diversity of large-scale blind-reference datasets, the perception rule between image content and image quality is established. Third, a quality prediction network is proposed by combining debiased content-aware and content-agnostic features to predict the final image quality score. To demonstrate the efficacy of our proposed method, we conducted numerous experiments on comprehensive databases. The experimental results validate that our method achieves state-of-the-art performance in predicting image quality.
引用
收藏
页码:545 / 554
页数:10
相关论文
共 50 条
  • [1] A novel discrete wavelet transform framework for full reference image quality assessment
    Soroosh Rezazadeh
    Stéphane Coulombe
    Signal, Image and Video Processing, 2013, 7 : 559 - 573
  • [2] A novel discrete wavelet transform framework for full reference image quality assessment
    Rezazadeh, Soroosh
    Coulombe, Stephane
    SIGNAL IMAGE AND VIDEO PROCESSING, 2013, 7 (03) : 559 - 573
  • [3] Full Reference Image Quality Assessment : Limitation
    Chetouani, Aladine
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 833 - 837
  • [4] Full reference and reduced reference metrics for image quality assessment
    Carnec, M
    Le Callet, P
    Barba, D
    SEVENTH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS, VOL 1, PROCEEDINGS, 2003, : 477 - 480
  • [5] A No-Reference and Full-Reference image quality assessment and enhancement framework in real-time
    Zahi Al Chami
    Chady Abou Jaoude
    Richard Chbeir
    Mahmoud Barhamgi
    Mansour Naser Alraja
    Multimedia Tools and Applications, 2022, 81 : 32491 - 32517
  • [6] A No-Reference and Full-Reference image quality assessment and enhancement framework in real-time
    Al Chami, Zahi
    Abou Jaoude, Chady
    Chbeir, Richard
    Barhamgi, Mahmoud
    Alraja, Mansour Naser
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (22) : 32491 - 32517
  • [7] UNIFYING ANALYSIS OF FULL REFERENCE IMAGE QUALITY ASSESSMENT
    Seshadrinathan, Kalpana
    Bovik, Alan C.
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 1200 - 1203
  • [8] Investigation of Full-Reference Image Quality Assessment
    Das, Dibyasundar
    Nayak, Ajit Kumar
    INTELLIGENT COMPUTING, COMMUNICATION AND DEVICES, 2015, 309 : 449 - 456
  • [9] Review and Prospect of Full Reference Image Quality Assessment
    全参考图像质量评价回顾与展望
    1600, Chinese Institute of Electronics (49): : 2261 - 2272
  • [10] An image response framework for no-reference image quality assessment
    Sun, Tongfeng
    Ding, Shifei
    Xu, Xinzheng
    COMPUTERS & ELECTRICAL ENGINEERING, 2018, 70 : 764 - 776