No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

被引:0
|
作者
Xu, Kepeng [1 ]
He, Gang [1 ]
Qiao, Tong [1 ]
Liu, Zhenyang [1 ]
机构
[1] Xidian Univ, Xian, Peoples R China
关键词
Image Quality Assessment; Neural Network;
D O I
10.1145/3689093.3689184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.
引用
收藏
页码:21 / 29
页数:9
相关论文
共 50 条
  • [41] Unsupervised Feature Learning Framework for No-reference Image Quality Assessment
    Ye, Peng
    Kumar, Jayant
    Kang, Le
    Doermann, David
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 1098 - 1105
  • [42] No-Reference Video Quality Assessment Using the Temporal Statistics of Global and Local Image Features
    Varga, Domonkos
    SENSORS, 2022, 22 (24)
  • [43] A No-Reference Image Quality Assessment
    Kemalkar, Aniket K.
    Bairagi, Vinayak K.
    2013 IEEE INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN COMPUTING, COMMUNICATION AND NANOTECHNOLOGY (ICE-CCN'13), 2013, : 462 - 465
  • [44] Reduced-reference image deblurring quality assessment based on multi-scale feature enhancement and aggregation
    Hu, Bo
    Wang, Shuaijian
    Gao, Xinbo
    Li, Leida
    Gan, Ji
    Nie, Xixi
    NEUROCOMPUTING, 2023, 547
  • [45] No-Reference Multi-Scale Blur Metric
    Harrity, Kyle
    Ezekiel, Soundararajan
    Ferris, Michael
    Cornacchia, Maria
    Blasch, Erik
    IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON 2014), 2014, : 103 - 108
  • [46] A Deep Neural Network Based on Layer-by-Layer Fusion of Multi-Scale Features for No-Reference Image Quality Assessment
    Yang, Chunling
    Yang, Yajing
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2022, 50 (04): : 81 - 89
  • [47] No-Reference Image Quality Assessment based on Local Binary Patterns
    Nenakhov, I.
    Khryashchev, V.
    Priorov, A.
    PROCEEDINGS OF 2016 IEEE EAST-WEST DESIGN & TEST SYMPOSIUM (EWDTS), 2016,
  • [48] No-Reference Image Quality Assessment Based on Local Region Statistics
    Li, Qiaohong
    Lin, Weisi
    Fang, Yuming
    Zhang, Xinfeng
    Zhang, Yabin
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [49] No-reference image quality assessment based on local maximum gradient
    Jiang, Ping
    Zhang, Jian-Zhou
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2015, 37 (11): : 2587 - 2593
  • [50] No-Reference Image Quality Assessment Using Image Statistics and Robust Feature Descriptors
    Oszust, Mariusz
    IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (11) : 1656 - 1660