No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

被引:0
|
作者
Xu, Kepeng [1 ]
He, Gang [1 ]
Qiao, Tong [1 ]
Liu, Zhenyang [1 ]
机构
[1] Xidian Univ, Xian, Peoples R China
关键词
Image Quality Assessment; Neural Network;
D O I
10.1145/3689093.3689184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.
引用
收藏
页码:21 / 29
页数:9
相关论文
共 50 条
  • [21] No-reference image quality assessment of multi-level residual feature augmentation
    Liu, Chunxia
    Zheng, Yuanlin
    Liao, Kaiyang
    Chen, Bing
    Wang, Kaidi
    Zhong, Chongjun
    Xie, Bo
    Miao, Yalin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (04) : 1275 - 1283
  • [22] Feature rectification and enhancement for no-reference image quality assessment
    Wu, Wei
    Huang, Daoquan
    Yao, Yang
    Shen, Zhuonan
    Zhang, Hua
    Yan, Chenggang
    Zheng, Bolun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 98
  • [23] Feature rectification and enhancement for no-reference image quality assessment
    Wu, Wei
    D., Huang
    Y., Yao
    Z., Shen
    H., Zhang
    C., Yan
    B., Zheng
    Journal of Visual Communication and Image Representation, 2024, 98
  • [24] Local Quality Pattern (LQP) : A Quality Aware Local Statistical Feature Descriptor for No-Reference Image Quality Assessment
    Kyal, Chirag
    Poddar, Harsh
    Bhattacharya, Shubhobrata
    2021 6TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2021,
  • [25] No-reference image quality assessment of authentically distorted images with global and local statistics
    Milosz Rajchel
    Mariusz Oszust
    Signal, Image and Video Processing, 2021, 15 : 83 - 91
  • [26] No-reference image quality assessment of authentically distorted images with global and local statistics
    Rajchel, Milosz
    Oszust, Mariusz
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (01) : 83 - 91
  • [27] No-reference stereoscopic image quality assessment based on global and local content characteristics
    Shen, Lili
    Chen, Xiongfei
    Pan, Zhaoqing
    Fan, Kefeng
    Li, Fei
    Lei, Jianjun
    NEUROCOMPUTING, 2021, 424 : 132 - 142
  • [28] NO-REFERENCE VIDEO QUALITY ASSESSMENT VIA FEATURE LEARNING
    Xu, Jingtao
    Ye, Peng
    Liu, Yong
    Doermann, David
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 491 - 495
  • [29] No-reference Image Quality Assessment via Non-local Dependency Modeling
    Jia, Shuyue
    Chen, Baoliang
    Li, Dingquan
    Wang, Shiqi
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [30] No-Reference Image Quality Assessment with Global Statistical Features
    Varga, Domonkos
    JOURNAL OF IMAGING, 2021, 7 (02)