The context effect for blind image quality assessment

被引:7
|
作者
Liang, Zehong [1 ]
Lu, Wen [1 ]
Zheng, Yong [1 ]
He, Weiquan [1 ]
Yang, Jiachen [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Blind image quality assessment; Context effect; Probability graph;
D O I
10.1016/j.neucom.2022.11.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image quality assessment (IQA) is a process of visuo-cognitive, which is an essential stage in human interaction with the environment. The study of the context effect (Brown and Daniel, 1987) also shows that the evaluation results made by the human vision system (HVS) is related to the contrast between the distorted image and the background environment. However, the existing IQA methods carry out the quality evaluation that only depends on the distorted image itself and ignores the impact of environ-ment to human perception. In this paper, we propose a novel blind image quality assessment(BIQA) based on the context effect. At first, we use a graphical model to describe how the context effect influ-ences human perception of image quality. Based on the established graph, we construct the context rela-tion between the distorted image and the background environment by the X. Han et al. (2015). Then the context features are extracted from the constructed relation, and the quality-related features are extracted by the fine-tuned neural network from the distorted image in pixel-wise. Finally, these features are concatenated to quantify image quality degradations and then regress to quality scores. In addition, the proposed method is adaptive to various deep neural networks. Experimental results show that the proposed method not only has the state-of-art performance on the synthetic distorted images, but also has a great improvement on the authentic distorted images.(c) 2022 Published by Elsevier B.V.
引用
收藏
页码:172 / 180
页数:9
相关论文
共 50 条
  • [21] Continual Learning for Blind Image Quality Assessment
    Zhang, Weixia
    Li, Dingquan
    Ma, Chao
    Zhai, Guangtao
    Yang, Xiaokang
    Ma, Kede
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 2864 - 2878
  • [22] Blind Image Quality Assessment by Pairwise Ranking Image Series
    Xu, Li
    Jiang, Xiuhua
    CHINA COMMUNICATIONS, 2023, 20 (09) : 127 - 143
  • [23] Blind Image Quality Assessment by Pairwise Ranking Image Series
    Li Xu
    Xiuhua Jiang
    ChinaCommunications, 2023, 20 (09) : 127 - 143
  • [24] Augmenting Blind Image Quality Assessment using Image Semantics
    Siahaan, Ernestasia
    Hanjalic, Alan
    Redi, Judith A.
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2016, : 307 - 312
  • [25] Quality-Aware CLIP for Blind Image Quality Assessment
    Pan, Wensheng
    Yang, Zhifu
    Liu, DingMing
    Fang, Chenxin
    Zhang, Yan
    Dai, Pingyang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VI, 2024, 14430 : 396 - 408
  • [26] Blind Predicting Similar Quality Map for Image Quality Assessment
    Pan, Da
    Shi, Ping
    Hou, Ming
    Ying, Zefeng
    Fu, Sizhe
    Zhang, Yuan
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6373 - 6382
  • [27] An improved blind/referenceless image spatial quality evaluator algorithm for image quality assessment
    Li, Xuesong
    Pan, Jinfeng
    Shang, Jianrun
    Souri, Alireza
    Gao, Mingliang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2024, 27 (01) : 48 - 56
  • [28] Blind Image Quality Assessment via Deep Learning
    Hou, Weilong
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (06) : 1275 - 1286
  • [29] Test Time Adaptation for Blind Image Quality Assessment
    Roy, Subhadeep
    Mitra, Shankhanil
    Biswas, Soma
    Soundararajan, Rajiv
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 16696 - 16705
  • [30] HOMOGENEITY BASED BLIND NOISY IMAGE QUALITY ASSESSMENT
    Huang, Xiaotong
    Chen, Li
    Tian, Jing
    Zhang, Xiaolong
    Fu, Xiaowei
    2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 2963 - 2967