Blind Image Quality Assessment via Adaptive Graph Attention

被引:10
|
作者
Wang, Huasheng [1 ]
Liu, Jiang [1 ]
Tan, Hongchen [2 ]
Lou, Jianxun [1 ]
Liu, Xiaochang [3 ]
Zhou, Wei [1 ]
Liu, Hantao [1 ]
机构
[1] Cardiff Univ, Sch Comp Sci Informat, Cardiff CF10 3AT, Wales
[2] Dalian Univ Technol, Coll Future Technol, Dalian 116024, Peoples R China
[3] Sun Yat Sen Univ, Sch Math, Guangzhou 510275, Peoples R China
关键词
Transformers; Image quality; Feature extraction; Adaptation models; Predictive models; Deep learning; Task analysis; Image quality assessment; no-reference; graph; convolutional neural networks; deep learning; NATURAL SCENE STATISTICS;
D O I
10.1109/TCSVT.2024.3405789
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent advancements in blind image quality assessment (BIQA) are primarily propelled by deep learning technologies. While leveraging transformers can effectively capture long-range dependencies and contextual details in images, the significance of local information in image quality assessment can be undervalued. To address this challenging problem, we propose a novel feature enhancement framework tailored for BIQA. Specifically, we devise an Adaptive Graph Attention (AGA) module to simultaneously augment both local and contextual information. It not only refines the post-transformer features into an adaptive graph, facilitating local information enhancement, but also exploits interactions amongst diverse feature channels. The proposed technique can better reduce redundant information introduced during feature updates compared to traditional convolution layers, streamlining the self-updating process for feature maps. Experimental results show that our proposed model outperforms state-of-the-art BIQA models in predicting the perceived quality of images. The code is available at https://github.com/sky-whs/AGAIQA.
引用
收藏
页码:10299 / 10309
页数:11
相关论文
共 50 条
  • [1] Blind image quality assessment via learnable attention-based pooling
    Gu, Jie
    Meng, Gaofeng
    Xiang, Shiming
    Pan, Chunhong
    PATTERN RECOGNITION, 2019, 91 : 332 - 344
  • [2] Image Quality Assessment via Adaptive Pooling
    Zhang, Zhong
    Liu, Shuang
    Li, Ao
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2016, 386 : 709 - 714
  • [3] Blind Image Quality Assessment via Deep Learning
    Hou, Weilong
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (06) : 1275 - 1286
  • [4] Blind Image Quality Assessment via Multiperspective Consistency
    Guo, Ning
    Qingge, Letu
    Huang, Yuanchen
    Roy, Kaushik
    Li, Yanggui
    Yang, Pei
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [5] Blind Image Quality Assessment via Analysis of GLCM
    Yue, Guanghui
    Hou, Chunping
    Ma, Tongtong
    Yang, Yang
    HUMAN CENTERED COMPUTING, HCC 2017, 2018, 10745 : 95 - 101
  • [6] GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment
    Sun, Simeng
    Yu, Tao
    Xu, Jiahua
    Zhou, Wei
    Chen, Zhibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2912 - 2925
  • [7] Blind Image Quality Assessment Via Convolutional Neural Network
    Wu, Meiyin
    Chen, Li
    PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2016, : 221 - 224
  • [8] A Blind Video Quality Assessment Method via Spatiotemporal Pyramid Attention
    Shen, Wenhao
    Zhou, Mingliang
    Wei, Xuekai
    Wang, Heqiang
    Fang, Bin
    Ji, Cheng
    Zhuang, Xu
    Wang, Jason
    Luo, Jun
    Pu, Huayan
    Huang, Xiaoxu
    Wang, Shilong
    Cao, Huajun
    Feng, Yong
    Xiang, Tao
    Shang, Zhaowei
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (01) : 251 - 264
  • [9] Blind Omnidirectional Image Quality Assessment With Viewport Oriented Graph Convolutional Networks
    Xu, Jiahua
    Zhou, Wei
    Chen, Zhibo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1724 - 1737
  • [10] Blind image quality assessment
    Li, X
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL I, PROCEEDINGS, 2002, : 449 - 452