DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network

被引:41
|
作者
Pan, Zhaoqing [1 ]
Zhang, Hao [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Shao, Xiao [3 ]
Ling, Nam [4 ]
Kwong, Sam [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Distortion; Feature extraction; Image quality; Databases; Fuses; Semantics; Knowledge engineering; Blind image quality assessment; distortion-aware network; Siamese network; fusion network; DATABASE;
D O I
10.1109/TCSVT.2022.3188991
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
引用
收藏
页码:7518 / 7531
页数:14
相关论文
共 50 条
  • [31] Blind Image Quality Assessment for Multiple Distortion Image
    Jin, Chao
    Zhao, Xiangning
    Xiong, Qi
    Guo, Yina
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2022, 41 (10) : 5807 - 5826
  • [32] DaFIR: Distortion-Aware Representation Learning for Fisheye Image Rectification
    Liao, Zhaokang
    Zhou, Wengang
    Li, Houqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3606 - 3618
  • [33] Image Distortion Detection using Convolutional Neural Network
    Ahn, Namhyuk
    Kang, Byungkon
    Sohn, Kyung-Ah
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 220 - 225
  • [34] Distortion-aware Panoramic Image Resizing Using Seam Carving
    Choi, Bohyung
    Lee, Minyoung
    Jung, Seung-Won
    Lu, Yucheng
    2021 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2021,
  • [35] CONVOLUTIONAL NEURAL NETWORK FOR BLIND QUALITY EVALUATOR OF IMAGE SUPER-RESOLUTION
    Fang, Yuming
    Zhang, Chi
    2017 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS 2017), 2017, : 28 - 33
  • [36] Blind Surveillance Image Quality Assessment via Deep Neural Network Combined with the Visual Saliency
    Lu, Wei
    Sun, Wei
    Min, Xiongkuo
    Zhang, Zicheng
    Wang, Tao
    Zhu, Wenhan
    Yang, Xiaokang
    Zhai, Guangtao
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT II, 2022, 13605 : 136 - 146
  • [37] Multitask convolutional neural network for no-reference image quality assessment
    Huang, Yuge
    Tian, Xiang
    Chen, Yaowu
    Jiang, Rongxin
    JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (06)
  • [38] A MULTI-TASK CONVOLUTIONAL NEURAL NETWORK FOR BLIND STEREOSCOPIC IMAGE QUALITY ASSESSMENT USING NATURALNESS ANALYSIS
    Bourbia, Salima
    Karine, Ayoub
    Chetouani, Aladine
    El Hassoun, Mohammed
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1434 - 1438
  • [39] Tongue image quality assessment based on a deep convolutional neural network
    Jiang, Tao
    Hu, Xiao-juan
    Yao, Xing-hua
    Tu, Li-ping
    Huang, Jing-bin
    Ma, Xu-xiang
    Cui, Ji
    Wu, Qing-feng
    Xu, Jia-tuo
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2021, 21 (01)
  • [40] Direct Application of Convolutional Neural Network Features to Image Quality Assessment
    Hou, Xianxu
    Sun, Ke
    Liu, Bozhi
    Gong, Yuanhao
    Garibaldi, Jonathan
    Qiu, Guoping
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,