GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment

被引:62
|
作者
Sun, Simeng [1 ]
Yu, Tao [1 ]
Xu, Jiahua [1 ]
Zhou, Wei [1 ]
Chen, Zhibo [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engineer & Informat Sci, Hefei 230026, Anhui, Peoples R China
关键词
Blind image quality assessment; graph representation learning; pre-training; STATISTICS;
D O I
10.1109/TMM.2022.3152942
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A good distortion representation is crucial for the success of deep blind image quality assessment (BIQA). However, most previous methods do not effectively model the relationship between distortions or the distribution of samples with the same distortion type but different distortion levels. In this work, we start from the analysis of the relationship between perceptual image quality and distortion-related factors, such as distortion types and levels. Then, we propose a Distortion Graph Representation (DGR) learning framework for IQA, named GraphIQA, in which each distortion is represented as a graph, i.e., DGR. One can distinguish distortion types by learning the contrast relationship between these different DGRs, and can infer the ranking distribution of samples from different levels in a DGR. Specifically, we develop two sub-networks to learn the DGRs: a) Type Discrimination Network (TDN) that aims to embed DGR into a compact code for better discriminating distortion types and learning the relationship between types; b) Fuzzy Prediction Network (FPN) that aims to extract the distributional characteristics of the samples in a DGR and predicts fuzzy degrees based on a Gaussian prior. Experiments show that our GraphIQA achieves state-of-the-art performance on many benchmark datasets of both synthetic and authentic distortions.
引用
收藏
页码:2912 / 2925
页数:14
相关论文
共 50 条
  • [1] Blind Image Quality Assessment Based on Separate Representations and Adaptive Interaction of Content and Distortion
    Zhou, Zehong
    Zhou, Fei
    Qiu, Guoping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (04) : 2484 - 2497
  • [2] Blind Image Quality Assessment for Multiple Distortion Image
    Chao Jin
    Xiangning Zhao
    Qi Xiong
    Yina Guo
    Circuits, Systems, and Signal Processing, 2022, 41 : 5807 - 5826
  • [3] Blind Image Quality Assessment for Multiple Distortion Image
    Jin, Chao
    Zhao, Xiangning
    Xiong, Qi
    Guo, Yina
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2022, 41 (10) : 5807 - 5826
  • [4] Learning to Rank for Blind Image Quality Assessment
    Gao, Fei
    Tao, Dacheng
    Gao, Xinbo
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (10) : 2275 - 2290
  • [5] Continual Learning for Blind Image Quality Assessment
    Zhang, Weixia
    Li, Dingquan
    Ma, Chao
    Zhai, Guangtao
    Yang, Xiaokang
    Ma, Kede
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 2864 - 2878
  • [6] Blind Image Quality Assessment via Adaptive Graph Attention
    Wang, Huasheng
    Liu, Jiang
    Tan, Hongchen
    Lou, Jianxun
    Liu, Xiaochang
    Zhou, Wei
    Liu, Hantao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 10299 - 10309
  • [7] CDINet: Content Distortion Interaction Network for Blind Image Quality Assessment
    Zheng, Limin
    Luo, Yu
    Zhou, Zihan
    Ling, Jie
    Yue, Guanghui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7089 - 7100
  • [8] Blind Image Quality Assessment via Deep Learning
    Hou, Weilong
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (06) : 1275 - 1286
  • [9] On the use of deep learning for blind image quality assessment
    Bianco, Simone
    Celona, Luigi
    Napoletano, Paolo
    Schettini, Raimondo
    SIGNAL IMAGE AND VIDEO PROCESSING, 2018, 12 (02) : 355 - 362
  • [10] DEEP LEARNING NETWORK FOR BLIND IMAGE QUALITY ASSESSMENT
    Gu, Ke
    Zhai, Guangtao
    Yang, Xiaokang
    Zhang, Wenjun
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 511 - 515