No-reference image quality assessment based on an objective quality database and deep neural networks

被引:1
|
作者
Zhang, Xiazhao [1 ]
Yan, Peng [1 ]
Mou, Xuanqin [1 ]
机构
[1] Xi An Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
image quality assessment (IQA); no-reference IQA (NRIQA); convolutional neural network (CNN); objective IQA database; opinion-unaware NRIQA (OU-NRIQA); GRADIENT MAGNITUDE; SIMILARITY; STATISTICS; SCORES;
D O I
10.1117/12.2536868
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Image quality assessment (IQA) has always been an active research topic since the birth of the digital image. Actually, the arrival of deep learning has made IQA more promising. However, most state-of-the-art no-reference (NR) IQA methods require regression training on distorted images or extracted features with subjective image scores, which makes them suffer from insufficient reference image content and training samples with subjectively scoring due to timeconsuming and laborious subjective testing. Furthermore, most convolutional neural networks (CNN)-based methods generally transform original images into patches to accommodate fixed-size input of CNN, which often alter the image's data and introduce noise into the neural network. This paper aims to solve the above problems by adopting new strategies and proposes a novel NRIQA method based on deep CNN. Specifically, first, we obtain image data with diverse image content, multiple image sizes, and reasonable distortion by crawling, filtrating, and degrading numerous publicly licensed high-quality images from the Internet. Then, we score all the images using an excellent full-reference (FR) IQA algorithm, thereby artificially construct a large objective IQA database. Next, we design a deep CNN, which can accept input images of original sizes from our database instead of patches, then we train the model with the FRIQA index as training objective thus propose the opinionunaware(OU) NRIQA method. Finally, the experiment results show that our method achieves excellent performance, which outperforms state-of-the-art OU-NRIQA models and is comparable to most of the traditional opinion-aware NRIQA methods, even some FRIQA methods on standard subjective IQA databases.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] No-reference image quality assessment based on deep convolutional neural networks
    Ravela, Ravi
    Shirvaikar, Mukul
    Grecos, Christos
    [J]. REAL-TIME IMAGE PROCESSING AND DEEP LEARNING 2019, 2019, 10996
  • [2] No-reference Image Quality Assessment with Deep Convolutional Neural Networks
    Li, Yuming
    Po, Lai-Man
    Feng, Litong
    Yuan, Fang
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2016, : 685 - 689
  • [3] Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
    Bosse, Sebastian
    Maniry, Dominique
    Mueller, Klaus-Robert
    Wiegand, Thomas
    Samek, Wojciech
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 206 - 219
  • [4] No-reference image quality assessment with shearlet transform and deep neural networks
    Li, Yuming
    Po, Lai-Man
    Xu, Xuyuan
    Feng, Litong
    Yuan, Fang
    Cheung, Chun-Ho
    Cheung, Kwok-Wai
    [J]. NEUROCOMPUTING, 2015, 154 : 94 - 109
  • [5] DEEP NEURAL NETWORKS FOR NO-REFERENCE VIDEO QUALITY ASSESSMENT
    You, Junyong
    Korhonen, Jari
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2349 - 2353
  • [6] Convolutional Neural Networks for No-Reference Image Quality Assessment
    Kang, Le
    Ye, Peng
    Li, Yi
    Doermann, David
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1733 - 1740
  • [7] CURVELET BASED NO-REFERENCE OBJECTIVE IMAGE QUALITY ASSESSMENT
    Shen, Ji
    Li, Qin
    Erlebacher, Gordon
    [J]. PCS: 2009 PICTURE CODING SYMPOSIUM, 2009, : 153 - +
  • [8] AN ACCURATE DEEP CONVOLUTIONAL NEURAL NETWORKS MODEL FOR NO-REFERENCE IMAGE QUALITY ASSESSMENT
    Bare, Bahetiyaer
    Li, Ke
    Yan, Bo
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 1356 - 1361
  • [9] No-reference image quality assessment based on residual neural networks (ResNets)
    Ravela, Ravi
    Shirvaikar, Mukul
    Grecos, Christos
    [J]. REAL-TIME IMAGE PROCESSING AND DEEP LEARNING 2020, 2020, 11401
  • [10] Evaluating Convolutional Neural Networks for No-Reference Image Quality Assessment
    Apostolidis, Kyriakos D.
    Polyzos, Theodore
    Grigoriadis, Ioannis
    Papakostas, George A.
    [J]. 2021 4TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INFORMATION SECURITY (ICSPIS), 2021,