VP-NIQE: An opinion-unaware visual perception natural image quality evaluator

被引:17
|
作者
Wu, Leyuan [1 ]
Zhang, Xiaogang [1 ]
Chen, Hua [2 ]
Wang, Dingxiang [1 ]
Deng, Jingfang [1 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha, Peoples R China
[2] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha, Peoples R China
基金
国家重点研发计划;
关键词
Blind image quality assessment (BIQA); Opinion unaware (OU); Top-down perception theory; Foreground object recognition; STATISTICS;
D O I
10.1016/j.neucom.2021.08.048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The opinion-unaware (OU) blind image quality assessment (IQA) method shows broad application prospects due to the explosive growth of unlabelled images. Under a local quality perception framework, many works have focused on extracting more complex natural scene statistical (NSS) features to boost the performance. The framework, however, is seldom studied. In addition, NSS features are designed using the prior knowledge of the human visual system (HVS), which is insufficiently powerful for broad types of distortions. Therefore, this paper proposes a visual perception nature image quality evaluation (VP-NIQE) model. Specifically, we propose an understanding-based global-local structure IQA model to simulate the top-down structure of the HVS in image perception. Furthermore, we enriched the feature types from a more comprehensive perspective in local distortion detection. In addition to the NSS features, histogram and deep-learned features are incorporated to detect the distortions. NSS and histogram features represent the low-level prior knowledge of the HVS, while deep-learned features represent the high-level information behind the data. The proposed method is evaluated on six benchmark databases. The evaluation results demonstrate that the proposed method achieves state-of-the-art performance compared with existing OU methods and even generates competitive performance compared with classical full-reference methods. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:17 / 28
页数:12
相关论文
共 50 条
  • [1] REVISITING NATURAL SCENE STATISTICAL MODELING USING DEEP FEATURES FOR OPINION-UNAWARE IMAGE QUALITY ASSESSMENT
    Mahmoudpour, Saeed
    Schelkens, Peter
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1471 - 1475
  • [2] A STUDY ON THE USABILITY OF OPINION-UNAWARE NO-REFERENCE NATURAL IMAGE QUALITY METRICS IN THE CONTEXT OF MEDICAL IMAGES
    Outtas, M.
    Zhang, L.
    Deforges, O.
    Hammidouche, W.
    Serir, A.
    Cavaro-Menard, C.
    [J]. 2016 INTERNATIONAL SYMPOSIUM ON SIGNAL, IMAGE, VIDEO AND COMMUNICATIONS (ISIVC), 2016, : 308 - 313
  • [3] OPINION-UNAWARE NO-REFERENCE IMAGE QUALITY ASSESSMENT OF SMARTPHONE CAMERA IMAGES BASED ON AESTHETICS AND HUMAN PERCEPTION
    Yuan, Zifeng
    Qi, Yi
    Hu, Menghan
    Li, Qingli
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [4] Recycling Discriminator: Towards Opinion-Unaware Image Quality Assessment Using Wasserstein GAN
    Zhu, Yunan
    Ma, Haichuan
    Peng, Jialun
    Liu, Dong
    Xiong, Zhiwei
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 116 - 125
  • [5] EXPLORING OPINION-UNAWARE VIDEO QUALITY ASSESSMENT WITH SEMANTIC AFFINITY CRITERION
    Wu, Haoning
    Liao, Liang
    Hou, Jingwen
    Chen, Chaofeng
    Zhang, Erli
    Wang, Annan
    Sun, Wenxiu
    Yan, Qiong
    Lin, Weisi
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 366 - 371
  • [6] An Opinion-unaware Blind Quality Assessment Algorithm for Multiply Distorted Images
    Wang, Tongle
    Deng, Junchen
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING SYSTEMS, 2019, 11384
  • [7] No-Reference Quality Assessment for Pansharpened Images via Opinion-Unaware Learning
    Zhou, Bingzhong
    Shao, Feng
    Meng, Xiangchao
    Fu, Randi
    Ho, Yo-Sung
    [J]. IEEE ACCESS, 2019, 7 : 40388 - 40401
  • [8] Opinion-unaware blind picture quality measurement using deep encoder-decoder architecture
    Zhou, Wujie
    Lin, Xinyang
    Zhou, Xi
    Lei, Jingsheng
    Yu, Lu
    Luo, Ting
    [J]. DIGITAL SIGNAL PROCESSING, 2020, 107
  • [9] Opinion-Unaware Blind Quality Assessment of Multiply and Singly Distorted Images via Distortion Parameter Estimation
    Zhang, Yi
    Chandler, Damon M.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (11) : 5433 - 5448
  • [10] No Reference, Opinion Unaware Image Quality Assessment by Anomaly Detection
    Leonardi, Marco
    Napoletano, Paolo
    Schettini, Raimondo
    Rozza, Alessandro
    [J]. SENSORS, 2021, 21 (03) : 1 - 16