A Multiscale Approach to Deep Blind Image Quality Assessment

被引:8
|
作者
Liu, Manni [1 ]
Huang, Jiabin [2 ]
Zeng, Delu [3 ]
Ding, Xinghao [4 ]
Paisley, John [5 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510006, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Technol, Xiamen 361005, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Peoples R China
[4] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
基金
中国国家自然科学基金;
关键词
Image quality; Feature extraction; Distortion; Sensitivity; Visualization; Task analysis; Predictive models; Blind image quality assessment; NR-IQA; multi-scale; deep learning; CNN; FIDELITY-CRITERION; NEURAL-NETWORKS; STATISTICS; NORMALIZATION; INFORMATION; SIMILARITY;
D O I
10.1109/TIP.2023.3245991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieve better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands through multiscale filtering and extract features to map an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.
引用
收藏
页码:1656 / 1667
页数:12
相关论文
共 50 条
  • [41] ADGNet: Attention Discrepancy Guided Deep Neural Network for Blind Image Quality Assessment
    Ma, Xiaoyu
    Wang, Yaqi
    Liu, Chang
    Zhang, Suiyu
    Yu, Dingguo
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1309 - 1318
  • [42] Blind Image Quality Assessment via Deep Recursive Convolutional Network with Skip Connection
    Yan, Qingsen
    Sun, Jinqiu
    Su, Shaolin
    Zhu, Yu
    Li, Haisen
    Zhang, Yanning
    PATTERN RECOGNITION AND COMPUTER VISION, PT II, 2018, 11257 : 51 - 61
  • [43] Blind light field image quality assessment based on deep meta-learning
    Ma, Jian
    Zhang, Xiaoyin
    Wang, Junbo
    OPTICS LETTERS, 2023, 48 (23) : 6184 - 6187
  • [44] COMBINATION OF DEEP LEARNING-BASED AND HANDCRAFTED FEATURES FOR BLIND IMAGE QUALITY ASSESSMENT
    Chetouani, Aladine
    Quach, Maurice
    Valenzise, Giuseppe
    Dufaux, Frederic
    PROCEEDINGS OF THE 2021 9TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2021,
  • [45] Blind CT image quality assessment via deep learning strategy: Initial Study
    Li, Sui
    He, Ji
    Wang, Yongbo
    Liao, Yuting
    Zeng, Dong
    Bian, Zhaoying
    Ma, Jianhua
    MEDICAL IMAGING 2018: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2018, 10577
  • [46] Blind image quality assessment with hierarchy: Degradation from local structure to deep semantics
    Wu, Jinjian
    Zeng, Jichen
    Dong, Weisheng
    Shi, Guangming
    Lin, Weisi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 : 353 - 362
  • [47] From Distortion Manifold to Perceptual Quality: a Data Efficient Blind Image? Quality Assessment Approach
    Su, Shaolin
    Yan, Qingsen
    Zhu, Yu
    Sun, Jinqiu
    Zhang, Yanning
    PATTERN RECOGNITION, 2023, 133
  • [48] Image Quality Assessment Based on Multiscale Geometric Analysis
    Gao, Xinbo
    Lu, Wen
    Tao, Dacheng
    Li, Xuelong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (07) : 1409 - 1423
  • [49] Multiscale Image Blind Denoising
    Lebrun, Marc
    Colom, Miguel
    Morel, Jean-Michel
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (10) : 3149 - 3161
  • [50] Sparse Representation for Blind Image Quality Assessment
    He, Lihuo
    Tao, Dacheng
    Li, Xuelong
    Gao, Xinbo
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 1146 - 1153