A Multiscale Approach to Deep Blind Image Quality Assessment

被引:8
|
作者
Liu, Manni [1 ]
Huang, Jiabin [2 ]
Zeng, Delu [3 ]
Ding, Xinghao [4 ]
Paisley, John [5 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510006, Peoples R China
[2] Xiamen Univ, Sch Informat Sci & Technol, Xiamen 361005, Peoples R China
[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510006, Peoples R China
[4] Xiamen Univ, Sch Informat, Xiamen 361005, Peoples R China
[5] Columbia Univ, Dept Elect Engn, New York, NY 10027 USA
基金
中国国家自然科学基金;
关键词
Image quality; Feature extraction; Distortion; Sensitivity; Visualization; Task analysis; Predictive models; Blind image quality assessment; NR-IQA; multi-scale; deep learning; CNN; FIDELITY-CRITERION; NEURAL-NETWORKS; STATISTICS; NORMALIZATION; INFORMATION; SIMILARITY;
D O I
10.1109/TIP.2023.3245991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieve better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands through multiscale filtering and extract features to map an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.
引用
收藏
页码:1656 / 1667
页数:12
相关论文
共 50 条
  • [21] Blind Image Quality Assessment via Deep Response Feature Decomposition and Aggregation
    Wang, Hui
    Wang, Guangcheng
    Xia, Wenjun
    Yang, Ziyuan
    Yu, Hui
    Fang, Leyuan
    Zhang, Yi
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (06) : 1165 - 1177
  • [22] A Deep Blind Image Quality Assessment with Visual Importance Based Patch Score
    Lv, Zhengyi
    Wang, Xiaochuan
    Wang, Kai
    Liang, Xiaohui
    COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 147 - 162
  • [23] Deep Blind Image Quality Assessment Powered by Online Hard Example Mining
    Wang, Zhihua
    Jiang, Qiuping
    Zhao, Shanshan
    Feng, Wensen
    Lin, Weisi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4774 - 4784
  • [24] Blind Image Quality Assessment Bases On Natural Scene Statistics And Deep Learning
    Ge, De
    Song, Jianxin
    PROCEEDINGS OF THE 2015 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND AUTOMATION ENGINEERING, 2016, 42 : 939 - 945
  • [25] Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
    Zhang, Weixia
    Ma, Kede
    Yan, Jia
    Deng, Dexiang
    Wang, Zhou
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (01) : 36 - 47
  • [26] END-TO-END BLIND IMAGE QUALITY ASSESSMENT WITH CASCADED DEEP FEATURES
    Wu, Jinjian
    Ma, Jupo
    Liang, Fuhu
    Dong, Weisheng
    Shi, Guangming
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1858 - 1863
  • [27] BLIND IMAGE QUALITY ASSESSMENT FOR NOISE
    Liu, Min
    Zhai, Guangtao
    Zhang, Zhenyu
    Sun, Yuntao
    Gu, Ke
    Yang, Xiaokang
    2014 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2014,
  • [28] PCANet for Blind Image Quality Assessment
    Jia, Huizhen
    Sun, Quansen
    Wang, Tonghan
    2015 11TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2015, : 195 - 198
  • [29] No training blind image quality assessment
    Chu, Ying
    Mou, Xuanqin
    Ji, Zhen
    DIGITAL PHOTOGRAPHY X, 2014, 9023
  • [30] Fully Deep Blind Image Quality Predictor
    Kim, Jongyoo
    Lee, Sanghoon
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (01) : 206 - 220