DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network

被引:41
|
作者
Pan, Zhaoqing [1 ]
Zhang, Hao [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Shao, Xiao [3 ]
Ling, Nam [4 ]
Kwong, Sam [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Distortion; Feature extraction; Image quality; Databases; Fuses; Semantics; Knowledge engineering; Blind image quality assessment; distortion-aware network; Siamese network; fusion network; DATABASE;
D O I
10.1109/TCSVT.2022.3188991
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
引用
收藏
页码:7518 / 7531
页数:14
相关论文
共 50 条
  • [1] Blind Image Quality Assessment Via Convolutional Neural Network
    Wu, Meiyin
    Chen, Li
    PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 1, 2016, : 221 - 224
  • [2] Image Quality Assessment Based on Distortion-Aware Decision Fusion
    Peng, Peng
    Li, Zenian
    INTELLIGENT SCIENCE AND INTELLIGENT DATA ENGINEERING, ISCIDE 2011, 2012, 7202 : 644 - 651
  • [3] DISTORTION RECOGNITION FOR IMAGE QUALITY ASSESSMENT WITH CONVOLUTIONAL NEURAL NETWORK
    Wang, Hanli
    Zuo, Lingxuan
    Fu, Jie
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2016,
  • [4] Visual Saliency Based Blind Image Quality Assessment via Convolutional Neural Network
    Li, Jie
    Zhou, Yue
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT VI, 2017, 10639 : 550 - 557
  • [5] CONVOLUTIONAL NEURAL NETWORK AND SALIENCY SELECTION FOR BLIND IMAGE QUALITY ASSESSMENT
    Chetouani, Aladine
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2835 - 2839
  • [6] General-purpose image quality assessment based on distortion-aware decision fusion
    Peng, Peng
    Li, Ze-Nian
    NEUROCOMPUTING, 2014, 134 : 117 - 121
  • [7] Retargeted image quality assessment based on multi-scale distortion-aware feature
    Wu Z.
    Zhang S.
    Niu Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2019, 45 (12): : 2487 - 2494
  • [8] Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network
    Zhang, Weixia
    Ma, Kede
    Yan, Jia
    Deng, Dexiang
    Wang, Zhou
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (01) : 36 - 47
  • [9] On the use of a scanpath predictor and convolutional neural network for blind image quality assessment
    Chetouani, Aladine
    Li, Leida
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 89
  • [10] SCREEN CONTENT IMAGE QUALITY ASSESSMENT VIA CONVOLUTIONAL NEURAL NETWORK
    Zuo, Lingxuan
    Wang, Hanli
    Fu, Jie
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2082 - 2086