Toward a Blind Deep Quality Evaluator for Stereoscopic Images Based on Monocular and Binocular Interactions

被引:67
|
作者
Shao, Feng [1 ]
Tian, Weijun [1 ]
Lin, Weisi [2 ]
Jiang, Gangyi [1 ]
Dai, Qionghai [3 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Engn, Ctr Multimedia & Network Technol, Singapore 639798, Singapore
[3] Tsinghua Univ, Broadband Networks & Digital Media Lab, Beijing 100084, Peoples R China
关键词
Deep quality evaluator; blind image quality assessment; stereoscopic image; deep neural network; NATURAL SCENE STATISTICS; RECEPTIVE-FIELDS; GAIN-CONTROL; COMPRESSION; COMBINATION; PERCEPTION; NETWORK; MODELS;
D O I
10.1109/TIP.2016.2538462
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During recent years, blind image quality assessment (BIQA) has been intensively studied with different machine learning tools. Existing BIQA metrics, however, do not design for stereoscopic images. We believe this problem can be resolved by separating 3D images and capturing the essential attributes of images via deep neural network. In this paper, we propose a blind deep quality evaluator (DQE) for stereoscopic images (denoted by 3D-DQE) based on monocular and binocular interactions. The key technical steps in the proposed 3D-DQE are to train two separate 2D deep neural networks (2D-DNNs) from 2D monocular images and cyclopean images to model the process of monocular and binocular quality predictions, and combine the measured 2D monocular and cyclopean quality scores using different weighting schemes. Experimental results on four public 3D image quality assessment databases demonstrate that in comparison with the existing methods, the devised algorithm achieves high consistent alignment with subjective assessment.
引用
收藏
页码:2059 / 2074
页数:16
相关论文
共 50 条
  • [1] Blind Stereoscopic Image Quality Evaluator Based on Binocular Semantic and Quality Channels
    Sim, Kyohoon
    Yang, Jiachen
    Lu, Wen
    Gao, Xinbo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1389 - 1398
  • [2] Monocular and Binocular Interactions Oriented Deformable Convolutional Networks for Blind Quality Assessment of Stereoscopic Omnidirectional Images
    Chai, Xiongli
    Shao, Feng
    Jiang, Qiuping
    Meng, Xiangchao
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3407 - 3421
  • [3] No -reference stereoscopic image quality evaluator with segmented monocular features and perceptual binocular features
    Liu, Yun
    Tang, Chang
    Zheng, Zhi
    Lin, Liyuan
    NEUROCOMPUTING, 2020, 405 : 126 - 137
  • [4] Blind Stereoscopic Image Quality Assessment Accounting for Human Monocular Visual Properties and Binocular Interactions
    Liu, Yun
    Yan, Weiqing
    Zheng, Zhi
    Huang, Baoqing
    Yu, Hongwei
    IEEE ACCESS, 2020, 8 : 33666 - 33678
  • [5] Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images
    Shao, Feng
    Lin, Weisi
    Jiang, Gangyi
    Dai, Qionghai
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2016, 2 (02) : 123 - 135
  • [6] Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation
    Shao, Feng
    Li, Kemeng
    Lin, Weisi
    Jiang, Gangyi
    Dai, Qionghai
    IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (10) : 2104 - 2114
  • [7] Blind Quality Assessment of Stereoscopic Images Considering Binocular Perception Based on Shearlet Decomposition
    Wan, Donghui
    Jiang, Xiuhua
    Shen, Qing
    IEEE ACCESS, 2023, 11 : 96387 - 96400
  • [8] Using Binocular Feature Combination for Blind Quality Assessment of Stereoscopic Images
    Shao, Feng
    Li, Kemeng
    Lin, Weisi
    Jiang, Gangyi
    Yu, Mei
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (10) : 1548 - 1551
  • [9] Deep blind quality evaluator for multiply distorted images based on monogenic binary coding
    Zhou, Wujie
    Yu, Lu
    Qian, Yaguan
    Qiu, Weiwei
    Zhou, Yang
    Luo, Ting
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 60 : 305 - 311
  • [10] Full-reference quality assessment of stereoscopic images by learning sparse monocular and binocular features
    Li, Kemeng
    Shao, Feng
    Jiang, Gangyi
    Yu, Mei
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY III, 2014, 9273