Toward a Blind Deep Quality Evaluator for Stereoscopic Images Based on Monocular and Binocular Interactions

被引:67
|
作者
Shao, Feng [1 ]
Tian, Weijun [1 ]
Lin, Weisi [2 ]
Jiang, Gangyi [1 ]
Dai, Qionghai [3 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Zhejiang, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Engn, Ctr Multimedia & Network Technol, Singapore 639798, Singapore
[3] Tsinghua Univ, Broadband Networks & Digital Media Lab, Beijing 100084, Peoples R China
关键词
Deep quality evaluator; blind image quality assessment; stereoscopic image; deep neural network; NATURAL SCENE STATISTICS; RECEPTIVE-FIELDS; GAIN-CONTROL; COMPRESSION; COMBINATION; PERCEPTION; NETWORK; MODELS;
D O I
10.1109/TIP.2016.2538462
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During recent years, blind image quality assessment (BIQA) has been intensively studied with different machine learning tools. Existing BIQA metrics, however, do not design for stereoscopic images. We believe this problem can be resolved by separating 3D images and capturing the essential attributes of images via deep neural network. In this paper, we propose a blind deep quality evaluator (DQE) for stereoscopic images (denoted by 3D-DQE) based on monocular and binocular interactions. The key technical steps in the proposed 3D-DQE are to train two separate 2D deep neural networks (2D-DNNs) from 2D monocular images and cyclopean images to model the process of monocular and binocular quality predictions, and combine the measured 2D monocular and cyclopean quality scores using different weighting schemes. Experimental results on four public 3D image quality assessment databases demonstrate that in comparison with the existing methods, the devised algorithm achieves high consistent alignment with subjective assessment.
引用
收藏
页码:2059 / 2074
页数:16
相关论文
共 50 条
  • [31] A FUSION-BASED BLIND IMAGE QUALITY METRIC FOR BLURRED STEREOSCOPIC IMAGES
    Chetouani, Aladine
    2017 3RD INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP), 2017, : 373 - 377
  • [32] A full-reference stereoscopic image quality assessment index based on stable aggregation of monocular and binocular visual features
    Si, Jianwei
    Yang, Huan
    Huang, Baoxiang
    Pan, Zhenkuan
    Su, Honglei
    IET IMAGE PROCESSING, 2021, 15 (08) : 1629 - 1643
  • [33] BLIND STEREOPAIR QUALITY ASSESSMENT USING STATISTICS OF MONOCULAR AND BINOCULAR IMAGE STRUCTURES
    Fan, Yu
    Larabi, Mohamed-Chaker
    Cheikh, Faouzi Alaya
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 430 - 434
  • [34] Learning a No-Reference Quality Predictor of Stereoscopic Images by Visual Binocular Properties
    Fang, Yuming
    Yan, Jiebin
    Wang, Jiheng
    Liu, Xuelin
    Zhai, Guangtao
    Le Callet, Patrick
    IEEE ACCESS, 2019, 7 : 132649 - 132661
  • [35] LEARNING NATURAL STATISTICS OF BINOCULAR CONTRAST FOR NO REFERENCE QUALITY ASSESSMENT OF STEREOSCOPIC IMAGES
    Zhang, Yi
    Chandler, Damon M.
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 186 - 190
  • [36] FULL-REFERENCE QUALITY ASSESSMENT OF STEREOSCOPIC IMAGES BY MODELING BINOCULAR RIVALRY
    Chen, Ming-Jun
    Su, Che-Chun
    Kwon, Do-Kyoung
    Cormack, Lawrence K.
    Bovik, Alan C.
    2012 CONFERENCE RECORD OF THE FORTY SIXTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS (ASILOMAR), 2012, : 721 - 725
  • [37] Perceived quality measurement of stereoscopic 3D images based on sparse representation and binocular combination
    Zhou, Wujie
    Zhou, Yang
    Qiu, Weiwei
    Luo, Ting
    Zhai, Zhinian
    DIGITAL SIGNAL PROCESSING, 2019, 93 : 128 - 137
  • [38] Joint binocular energy-contrast perception for quality assessment of stereoscopic images
    Ma, Jian
    An, Ping
    Shen, Liquan
    Li, Kai
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 65 : 33 - 45
  • [39] Blind Stereo Quality Assessment Based on Learned Features From Binocular Combined Images
    Karimi, Maryam
    Nejati, Mansour
    Soroushmehr, S. M. Reza
    Samavi, Shadrokh
    Karimi, Nader
    Najarian, Kayvan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (11) : 2475 - 2489
  • [40] STEREOSCOPIC IMAGE QUALITY METRIC BASED ON BINOCULAR PERCEPTION MODEL
    Ryu, Seungchul
    Kim, Dong Hyun
    Sohn, Kwanghoon
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 609 - 612