Blind Quality Index for Multiply Distorted Images Using Biorder Structure Degradation and Nonlocal Statistics

被引:40
|
作者
Zhou, Yu [1 ]
Li, Leida [1 ]
Wu, Jinjian [2 ]
Gu, Ke [3 ]
Dong, Weisheng [2 ]
Shi, Guangming [2 ]
机构
[1] China Univ Min & Technol, Sch Informat & Control Engn, Xuzhou 221116, Jiangsu, Peoples R China
[2] Xidian Univ, Sch Artif Intelligence, Xian 710071, Shaanxi, Peoples R China
[3] Beijing Univ Technol, BJUT, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Quality evaluation; multiply distorted images; spatial contrast; spatial distribution; biorder structures; nonlocal statistics; SHARPNESS ASSESSMENT; BLOCKING ARTIFACTS; GRADIENT MAGNITUDE; REGULARITY; EFFICIENT;
D O I
10.1109/TMM.2018.2829607
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the past decade, extensive image quality metrics have been proposed. The majority of them are tailored for the images that contain a specific type of distortion. However, in practice, the images are usually degraded by different types of distortions simultaneously. This poses great challenges to the existing quality metrics. Motivated by this, this paper proposes a no-reference quality index for the multiply distorted images using the biorder structure degradation and the nonlocal statistics. The design philosophy is inspired by the fact that the human visual system (HVS) is highly sensitive to the degradations of both the spatial contrast and the spatial distribution, which are prone to be changed by the joint effects of the multiple distortions. Specifically, the multiresolution representation of the image is first built by downsampling to simulate the hierarchical property of the HVS. Then, the structure degradation is calculated to measure the spatial contrast. Considering the fact that the human visual cortex has the separate mechanisms to perceive the first- and second-order structures, dubbed biorder structures, the degradations of biorder structures are calculated to account for the spatial contrast, producing the first group of the quality-aware features. Furthermore, the nonlocal self-similarity statistics is calculated to measure the spatial distribution, producing the second group of features. Finally, all the features are fed into the random forest regression model to learn the quality model for the multiply distorted images. Extensive experimental results conducted on the three public databases demonstrate the superiority of the proposed metric to the state-of-the-art metrics. Moreover, the proposed metric is also advantageous over the existing metrics in terms of the generalization ability.
引用
收藏
页码:3019 / 3032
页数:14
相关论文
共 50 条
  • [1] BLIND QUALITY ASSESSMENT OF MULTIPLY-DISTORTED IMAGES BASED ON STRUCTURAL DEGRADATION
    Dai, Tao
    Gu, Ke
    Xu, Zhi-ya
    Tang, Qingtao
    Liang, Haoyi
    Zhang, Yong-bing
    Xia, Shu-Tao
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 171 - 175
  • [2] Blind Quality Assessment of Multiply Distorted Images Using Deep Neural Networks
    Wang, Zhongling
    Athar, Shahrukh
    Wang, Zhou
    [J]. IMAGE ANALYSIS AND RECOGNITION, ICIAR 2019, PT I, 2019, 11662 : 89 - 101
  • [3] An Opinion-unaware Blind Quality Assessment Algorithm for Multiply Distorted Images
    Wang, Tongle
    Deng, Junchen
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING SYSTEMS, 2019, 11384
  • [4] Referenceless quality metric of multiply-distorted images based on structural degradation
    Dai, Tao
    Gu, Ke
    Niu, Li
    Zhang, Yong-bing
    Lu, Weizhi
    Xia, Shu-Tao
    [J]. NEUROCOMPUTING, 2018, 290 : 185 - 195
  • [5] Deep blind quality evaluator for multiply distorted images based on monogenic binary coding
    Zhou, Wujie
    Yu, Lu
    Qian, Yaguan
    Qiu, Weiwei
    Zhou, Yang
    Luo, Ting
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 60 : 305 - 311
  • [6] Multistage Pooling for Blind Quality Prediction of Asymmetric Multiply-Distorted Stereoscopic Images
    Shao, Feng
    Gao, Ying
    Jiang, Qiuping
    Jiang, Gangyi
    Ho, Yo-Sung
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (10) : 2605 - 2619
  • [7] BLIND IMAGE QUALITY ASSESSMENT FOR MULTIPLY DISTORTED IMAGES VIA CONVOLUTIONAL NEURAL NETWORKS
    Fu, Jie
    Wang, Hanli
    Zuo, Lingxuan
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1075 - 1079
  • [8] FISBLIM: A FIVE-STEP BLIND METRIC FOR QUALITY ASSESSMENT OF MULTIPLY DISTORTED IMAGES
    Gu, Ke
    Zhai, Guangtao
    Liu, Min
    Yang, Xiaokang
    Zhang, Wenjun
    Sun, Xianghui
    Chen, Wanhong
    Zuo, Ying
    [J]. 2013 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2013, : 241 - 246
  • [9] OBJECTIVE QUALITY ASSESSMENT OF MULTIPLY DISTORTED IMAGES
    Jayaraman, Dinesh
    Mittal, Anish
    Moorthy, Anush K.
    Bovik, Alan C.
    [J]. 2012 CONFERENCE RECORD OF THE FORTY SIXTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS (ASILOMAR), 2012, : 1693 - 1697
  • [10] BLIND MULTIPLY DISTORTED IMAGE QUALITY ASSESSMENT USING RELEVANT PERCEPTUAL FEATURES
    Li, Chaofeng
    Zhang, Yu
    Wu, Xiaojun
    Fang, Wei
    Mao, Li
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 4883 - 4886