GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment

被引:62
|
作者
Sun, Simeng [1 ]
Yu, Tao [1 ]
Xu, Jiahua [1 ]
Zhou, Wei [1 ]
Chen, Zhibo [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engineer & Informat Sci, Hefei 230026, Anhui, Peoples R China
关键词
Blind image quality assessment; graph representation learning; pre-training; STATISTICS;
D O I
10.1109/TMM.2022.3152942
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A good distortion representation is crucial for the success of deep blind image quality assessment (BIQA). However, most previous methods do not effectively model the relationship between distortions or the distribution of samples with the same distortion type but different distortion levels. In this work, we start from the analysis of the relationship between perceptual image quality and distortion-related factors, such as distortion types and levels. Then, we propose a Distortion Graph Representation (DGR) learning framework for IQA, named GraphIQA, in which each distortion is represented as a graph, i.e., DGR. One can distinguish distortion types by learning the contrast relationship between these different DGRs, and can infer the ranking distribution of samples from different levels in a DGR. Specifically, we develop two sub-networks to learn the DGRs: a) Type Discrimination Network (TDN) that aims to embed DGR into a compact code for better discriminating distortion types and learning the relationship between types; b) Fuzzy Prediction Network (FPN) that aims to extract the distributional characteristics of the samples in a DGR and predicts fuzzy degrees based on a Gaussian prior. Experiments show that our GraphIQA achieves state-of-the-art performance on many benchmark datasets of both synthetic and authentic distortions.
引用
收藏
页码:2912 / 2925
页数:14
相关论文
共 50 条
  • [41] BLIND IMAGE QUALITY ASSESSMENT FOR NOISE
    Liu, Min
    Zhai, Guangtao
    Zhang, Zhenyu
    Sun, Yuntao
    Gu, Ke
    Yang, Xiaokang
    2014 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2014,
  • [42] PCANet for Blind Image Quality Assessment
    Jia, Huizhen
    Sun, Quansen
    Wang, Tonghan
    2015 11TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2015, : 195 - 198
  • [43] No training blind image quality assessment
    Chu, Ying
    Mou, Xuanqin
    Ji, Zhen
    DIGITAL PHOTOGRAPHY X, 2014, 9023
  • [44] A PROPOSAL PROJECT FOR A BLIND IMAGE QUALITY ASSESSMENT BY LEARNING DISTORTIONS FROM THE FULL REFERENCE IMAGE QUALITY ASSESSMENTS
    Paris, Stefane
    2012 FOURTH INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2012, : 29 - 30
  • [45] Blind image quality assessment for measuring image blur
    Wang, Xin
    Tian, Baofeng
    Liang, Chao
    Shi, Dongcheng
    CISP 2008: FIRST INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOL 1, PROCEEDINGS, 2008, : 467 - +
  • [46] Blind Image Quality Assessment with Image Denoising: A Survey
    Padmapriya, R.
    Jeyasekar, A.
    JOURNAL OF PHARMACEUTICAL NEGATIVE RESULTS, 2022, 13 : 386 - 392
  • [47] BLIND HIGH DYNAMIC RANGE IMAGE QUALITY ASSESSMENT USING DEEP LEARNING
    Jia, Sen
    Zhang, Yang
    Agrafiotis, Dimitris
    Bull, David
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 765 - 769
  • [48] Blind Image Quality Assessment Bases On Natural Scene Statistics And Deep Learning
    Ge, De
    Song, Jianxin
    PROCEEDINGS OF THE 2015 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND AUTOMATION ENGINEERING, 2016, 42 : 939 - 945
  • [49] Blind image quality assessment based on progressive multi-task learning
    Li, Aobo
    Wu, Jinjian
    Tian, Shiwei
    Li, Leida
    Dong, Weisheng
    Shi, Guangming
    NEUROCOMPUTING, 2022, 500 (307-318) : 307 - 318
  • [50] Blind Image Quality Assessment: Exploring Content Fidelity Perceptibility via Quality Adversarial Learning
    Zhou, Mingliang
    Shen, Wenhao
    Wei, Xuekai
    Luo, Jun
    Jia, Fan
    Zhuang, Xu
    Jia, Weijia
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,