No-Reference Image Quality Assessment via Local and Global Multi-Scale Feature Integration

被引:0
|
作者
Xu, Kepeng [1 ]
He, Gang [1 ]
Qiao, Tong [1 ]
Liu, Zhenyang [1 ]
机构
[1] Xidian Univ, Xian, Peoples R China
关键词
Image Quality Assessment; Neural Network;
D O I
10.1145/3689093.3689184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the processes of image capture, transmission, processing, and storage, distortions are inevitable, degrading image quality and affecting both perception and information retrieval. Therefore, assessing image quality is crucial. Current deep learning-based no-reference image quality assessment (NR-IQA) methods face challenges: they fail to preserve both local sensitivity and global details through down-sampling, struggle with multi-scale feature extraction across various distortion types, and lack semantic content perception. Addressing these, we propose the Local and Global Multi-scale Feature (LGMF) algorithm for NR-IQA. This method introduces a grid-based random down-sampling module preserving both local and global details, a pyramid vision Transformer for multi-scale feature extraction, and a global semantic prior extraction module enhancing semantic content perception. Further, a cross-attention feature fusion module selectively integrates these elements, significantly improving quality assessments. The LGMF model also functions as a quality-aware loss function, guiding image restoration networks to achieve superior objective and subjective restoration results. Tested across six datasets, LGMF consistently outperforms existing NR-IQA methods, demonstrating superior generalization and effectiveness in image restoration tasks.
引用
收藏
页码:21 / 29
页数:9
相关论文
共 50 条
  • [31] No-reference image quality assessment based on global awareness
    Hu, Zhigang
    Yang, Gege
    Du, Zhe
    Huang, Xiaodong
    Zhang, Pujing
    Liu, Dechun
    PLOS ONE, 2024, 19 (10):
  • [32] No-Reference Image Quality Assessment with Local Gradient Orientations
    Oszust, Mariusz
    SYMMETRY-BASEL, 2019, 11 (01):
  • [33] HIERARCHICAL FEATURE FUSION TRANSFORMER FOR NO-REFERENCE IMAGE QUALITY ASSESSMENT
    Wang, Zesheng
    Wu, Wei
    Yuan, Liang
    Sun, Wei
    Chen, Ying
    Li, Kai
    Zhai, Guangtao
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2205 - 2209
  • [34] Two-channel deep recursive multi-scale network based on multi-attention for no-reference image quality assessment
    Wang, Changzhong
    Lv, Xiang
    Fan, Xiaodong
    Ding, Weiping
    Jiang, Xiaoli
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (07) : 2421 - 2437
  • [35] No-reference image quality assessment with learning phase congruency feature
    Li, Chao-Feng
    Tang, Guo-Feng
    Wu, Xiao-Jun
    Ju, Yi-Wen
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2013, 35 (02): : 484 - 488
  • [36] Two-channel deep recursive multi-scale network based on multi-attention for no-reference image quality assessment
    Changzhong Wang
    Xiang Lv
    Xiaodong Fan
    Weiping Ding
    Xiaoli Jiang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2421 - 2437
  • [37] No-reference image quality assessment based on feature tokenizer and Transformer
    Song, Wei
    Li, Jia-jin
    Liu, Xiao-chen
    Liu, Zhi-xiang
    Shi, Shao-hua
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2023, 38 (03) : 356 - 367
  • [38] New feature selection algorithms for no-reference image quality assessment
    Imran Fareed Nizami
    Muhammad Majid
    Khawar Khurshid
    Applied Intelligence, 2018, 48 : 3482 - 3501
  • [39] No-reference image quality assessment based on multiscale feature representation
    Li, Junhui
    Qiao, Shuang
    Zhao, Chenyi
    Zhang, Tian
    IET IMAGE PROCESSING, 2021, 15 (13) : 3318 - 3331
  • [40] New feature selection algorithms for no-reference image quality assessment
    Nizami, Imran Fareed
    Majid, Muhammad
    Khurshid, Khawar
    APPLIED INTELLIGENCE, 2018, 48 (10) : 3482 - 3501