DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network

被引:41
|
作者
Pan, Zhaoqing [1 ]
Zhang, Hao [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Shao, Xiao [3 ]
Ling, Nam [4 ]
Kwong, Sam [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Distortion; Feature extraction; Image quality; Databases; Fuses; Semantics; Knowledge engineering; Blind image quality assessment; distortion-aware network; Siamese network; fusion network; DATABASE;
D O I
10.1109/TCSVT.2022.3188991
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
引用
收藏
页码:7518 / 7531
页数:14
相关论文
共 50 条
  • [41] No-reference Image Quality Assessment Based on Convolutional Neural Network
    Chen, Yangming
    Jiang, Xiuhua
    2018 IEEE 18TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2018, : 1251 - 1255
  • [42] Blind Image Quality Assessment with Visual Sensitivity Enhanced Dual-Channel Deep Convolutional Neural Network
    Zhang, Min
    Hou, Wenjing
    Zhang, Lei
    Feng, Jun
    2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
  • [43] Tongue image quality assessment based on a deep convolutional neural network
    Tao Jiang
    Xiao-juan Hu
    Xing-hua Yao
    Li-ping Tu
    Jing-bin Huang
    Xu-xiang Ma
    Ji Cui
    Qing-feng Wu
    Jia-tuo Xu
    BMC Medical Informatics and Decision Making, 21
  • [44] BLIND UTILITY AND QUALITY ASSESSMENT USING A CONVOLUTIONAL NEURAL NETWORK AND A PATCH SELECTION
    Chetouani, A.
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 459 - 463
  • [45] OSRT: Omnidirectional Image Super-Resolution with Distortion-aware Transformer
    Yu, Fanghua
    Wang, Xintao
    Cao, Mingdeng
    Li, Gen
    Shan, Ying
    Dong, Chao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13283 - 13292
  • [46] Distortion-aware image retargeting based on continuous seam carving model
    Cui, Jia
    Cai, Qianqian
    Lu, Hongju
    Jia, Zhenlin
    Tang, Mingxi
    SIGNAL PROCESSING, 2020, 166
  • [47] DA Wand: Distortion-Aware Selection using Neural Mesh Parameterization
    Liu, Richard
    Aigerman, Noam
    Kim, Vladimir G.
    Hanocka, Rana
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16739 - 16749
  • [48] Blind Image Quality Assessment Using a General Regression Neural Network
    Li, Chaofeng
    Bovik, Alan Conrad
    Wu, Xiaojun
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (05): : 793 - 799
  • [49] Blind Image Quality Estimation via Distortion Aggravation
    Min, Xiongkuo
    Zhai, Guangtao
    Gu, Ke
    Liu, Yutao
    Yang, Xiaokang
    IEEE TRANSACTIONS ON BROADCASTING, 2018, 64 (02) : 508 - 517
  • [50] Structure recovery from single omnidirectional image with distortion-aware learning
    Meng, Ming
    Zhou, Yi
    Zuo, Dongshi
    Li, Zhaoxin
    Zhou, Zhong
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (07)