GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment

被引:62
|
作者
Sun, Simeng [1 ]
Yu, Tao [1 ]
Xu, Jiahua [1 ]
Zhou, Wei [1 ]
Chen, Zhibo [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engineer & Informat Sci, Hefei 230026, Anhui, Peoples R China
关键词
Blind image quality assessment; graph representation learning; pre-training; STATISTICS;
D O I
10.1109/TMM.2022.3152942
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A good distortion representation is crucial for the success of deep blind image quality assessment (BIQA). However, most previous methods do not effectively model the relationship between distortions or the distribution of samples with the same distortion type but different distortion levels. In this work, we start from the analysis of the relationship between perceptual image quality and distortion-related factors, such as distortion types and levels. Then, we propose a Distortion Graph Representation (DGR) learning framework for IQA, named GraphIQA, in which each distortion is represented as a graph, i.e., DGR. One can distinguish distortion types by learning the contrast relationship between these different DGRs, and can infer the ranking distribution of samples from different levels in a DGR. Specifically, we develop two sub-networks to learn the DGRs: a) Type Discrimination Network (TDN) that aims to embed DGR into a compact code for better discriminating distortion types and learning the relationship between types; b) Fuzzy Prediction Network (FPN) that aims to extract the distributional characteristics of the samples in a DGR and predicts fuzzy degrees based on a Gaussian prior. Experiments show that our GraphIQA achieves state-of-the-art performance on many benchmark datasets of both synthetic and authentic distortions.
引用
收藏
页码:2912 / 2925
页数:14
相关论文
共 50 条
  • [31] Blind Image Quality Estimation via Distortion Aggravation
    Min, Xiongkuo
    Zhai, Guangtao
    Gu, Ke
    Liu, Yutao
    Yang, Xiaokang
    IEEE TRANSACTIONS ON BROADCASTING, 2018, 64 (02) : 508 - 517
  • [32] Blind CT Image Quality Assessment via Deep Learning Framework
    Gao, Qi
    Li, Sui
    Zhu, Manman
    Li, Danyang
    Bian, Zhaoying
    Lyu, Qingwen
    Zeng, Dong
    Ma, Jianhua
    2019 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE (NSS/MIC), 2019,
  • [33] A hybrid learning-based framework for blind image quality assessment
    Wu, Meiyin
    Chen, Li
    Tian, Jing
    MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2018, 29 (03) : 839 - 849
  • [35] A hybrid learning-based framework for blind image quality assessment
    Meiyin Wu
    Li Chen
    Jing Tian
    Multidimensional Systems and Signal Processing, 2018, 29 : 839 - 849
  • [36] dipIQ: Blind Image Quality Assessment by Learning-to-Rank Discriminable Image Pairs
    Ma, Kede
    Liu, Wentao
    Liu, Tongliang
    Wang, Zhou
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (08) : 3951 - 3964
  • [37] Similarity learning for graph-based image representations
    de Mauro, C
    Diligenti, M
    Gori, M
    Maggini, M
    PATTERN RECOGNITION LETTERS, 2003, 24 (08) : 1115 - 1122
  • [38] DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network
    Pan, Zhaoqing
    Zhang, Hao
    Lei, Jianjun
    Fang, Yuming
    Shao, Xiao
    Ling, Nam
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7518 - 7531
  • [39] Image quality assessment based on manifold distortion
    Turkan, Mehmet
    PAMUKKALE UNIVERSITY JOURNAL OF ENGINEERING SCIENCES-PAMUKKALE UNIVERSITESI MUHENDISLIK BILIMLERI DERGISI, 2021, 27 (05): : 610 - 617
  • [40] Image Quality Assessment Based on Distortion Identification
    Chetouani, Aladine
    Beghdadi, Azeddine
    IMAGE QUALITY AND SYSTEM PERFORMANCE VIII, 2011, 7867