No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

被引:0
|
作者
Xu, Kepeng [1 ]
He, Gang [1 ]
Qiao, Tong [1 ]
Liu, Zhenyang [1 ]
机构
[1] Xidian Univ, Xian, Peoples R China
关键词
Image Quality Assessment; Neural Network;
D O I
10.1145/3689093.3689184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.
引用
收藏
页码:21 / 29
页数:9
相关论文
共 50 条
  • [1] No-Reference Image Quality Assessment Based on Image Multi-Scale Contour Prediction
    Wang, Fan
    Chen, Jia
    Zhong, Haonan
    Ai, Yibo
    Zhang, Weidong
    APPLIED SCIENCES-BASEL, 2022, 12 (06):
  • [2] NO-REFERENCE STEREOSCOPIC IMAGE QUALITY ASSESSMENT BASED ON LOCAL TO GLOBAL FEATURE REGRESSION
    Li, Sumei
    Xue, Jianwei
    Han, Yongtian
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 448 - 453
  • [3] No-reference Image Blur Assessment Based on Multi-scale Spatial Local Features
    Sun, Chenchen
    Cui, Ziguan
    Gan, Zongliang
    Liu, Feng
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (10): : 4060 - 4079
  • [4] No-Reference Image Quality Assessment with Multi-Scale Orderless Pooling of Deep Features
    Varga, Domonkos
    JOURNAL OF IMAGING, 2021, 7 (07)
  • [5] No-reference Stereoscopic Image Quality Assessment Based on Parallel Multi-scale Perception
    Zhang, Ziyi
    Li, Sumei
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [6] LG-IQA: Integration of local and global features for no-reference image quality assessment*
    Chang, Hua-Wen
    Du, Cheng-Yang
    Bi, Xiao-Dong
    Chen, Kai
    Wang, Ming-Hui
    DISPLAYS, 2022, 75
  • [7] No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism
    Wang, Changzhong
    Lv, Xiang
    Ding, Weiping
    Fan, Xiaodong
    SOFT COMPUTING, 2022, 26 (24) : 13449 - 13465
  • [8] Towards no-reference image quality assessment based on multi-scale convolutional neural network
    Ma, Yao
    Cai, Xibiao
    Sun, Fuming
    CMES - Computer Modeling in Engineering and Sciences, 2020, 123 (01): : 201 - 216
  • [9] No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism
    Changzhong Wang
    Xiang Lv
    Weiping Ding
    Xiaodong Fan
    Soft Computing, 2022, 26 : 13449 - 13465
  • [10] Texture dominated no-reference quality assessment for high resolution image by multi-scale mechanism
    Huang, Ziqing
    Liu, Hao
    Jia, Zhihao
    Zhang, Shuo
    Zhang, Yonghua
    Liu, Shiguang
    NEUROCOMPUTING, 2025, 636