DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network

被引:41
|
作者
Pan, Zhaoqing [1 ]
Zhang, Hao [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Shao, Xiao [3 ]
Ling, Nam [4 ]
Kwong, Sam [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Distortion; Feature extraction; Image quality; Databases; Fuses; Semantics; Knowledge engineering; Blind image quality assessment; distortion-aware network; Siamese network; fusion network; DATABASE;
D O I
10.1109/TCSVT.2022.3188991
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
引用
收藏
页码:7518 / 7531
页数:14
相关论文
共 50 条
  • [21] Distortion-Aware Convolutional Filters for Dense Prediction in Panoramic Images
    Tateno, Keisuke
    Navab, Nassir
    Tombari, Federico
    COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 732 - 750
  • [22] Recognition Oriented Facial Image Quality Assessment via Deep Convolutional Neural Network
    Pan, Cenhui
    Ni, Bingbing
    Xu, Yi
    Yang, Xiaokang
    8TH INTERNATIONAL CONFERENCE ON INTERNET MULTIMEDIA COMPUTING AND SERVICE (ICIMCS2016), 2016, : 160 - 163
  • [23] Recognition oriented facial image quality assessment via deep convolutional neural network
    Zhuang, Ning
    Zhang, Qiang
    Pan, Cenhui
    Ni, Bingbing
    Xu, Yi
    Yang, Xiaokang
    Zhang, Wenjun
    NEUROCOMPUTING, 2019, 358 : 109 - 118
  • [24] CDINet: Content Distortion Interaction Network for Blind Image Quality Assessment
    Zheng, Limin
    Luo, Yu
    Zhou, Zihan
    Ling, Jie
    Yue, Guanghui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7089 - 7100
  • [25] Stereoscopic image quality assessment by deep convolutional neural network
    Fang, Yuming
    Yan, Jiebin
    Liu, Xuelin
    Wang, Jiheng
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 : 400 - 406
  • [26] Stereoscopic Image Quality Assessment via Convolutional Neural Networks
    Sang, Qingbing
    Gu, Tingting
    Li, Chaofeng
    Wu, Xiaojun
    2017 INTERNATIONAL SMART CITIES CONFERENCE (ISC2), 2017,
  • [27] Blind light field image quality measurement via four-stream convolutional neural network
    Ma, Jian
    Wang, Junbo
    An, Ping
    Liu, Deyang
    Xu, Guoming
    DISPLAYS, 2025, 87
  • [28] A CONVOLUTIONAL NEURAL NETWORK FRAMEWORK FOR BLIND MESH VISUAL QUALITY ASSESSMENT
    Abouelaziz, Ilyass
    El Hassouni, Mohammed
    Cherifi, Hocine
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 755 - 759
  • [29] A Pre-Saliency Map Based Blind Image Quality Assessment via Convolutional Neural Networks
    Cheng, Zhengxue
    Takeuchi, Masaru
    Katto, Jiro
    2017 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2017, : 77 - 82
  • [30] Blind Image Quality Assessment for Multiple Distortion Image
    Chao Jin
    Xiangning Zhao
    Qi Xiong
    Yina Guo
    Circuits, Systems, and Signal Processing, 2022, 41 : 5807 - 5826