Jointly learning perceptually heterogeneous features for blind 3D video quality assessment

被引:10
|
作者
Wang, Yongfang [1 ,2 ]
Shuai, Yuan [1 ]
Zhu, Yun [1 ]
Zhang, Jian [3 ]
An, Ping [1 ,2 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Univ Technol Sydney, Global Big Data Technol Ctr, Sydney, NSW 2007, Australia
关键词
Blind quality metric; Binocular spatio-temporal internal generative mechanism; Multi-channel natural video statistics; AdaBoosting radial basis function (RBF) neural network; SIMILARITY; IMAGES;
D O I
10.1016/j.neucom.2018.12.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D videos quality assessment (3D-VQA) is essential to various 3D video processing applications. However, it has not been well investigated on how to make use of perceptual multi-channel video information to improve 3D-VQA under different distortion categories and degrees, especially under asymmetrical distortions. In the paper, we propose a new blind 3D-VQA metric by jointly learning perceptually heterogeneous features. Firstly, a binocular spatio-temporal internal generative mechanism (BST-IGM) is proposed to decompose the views of 3D video into multi-channel videos. Then, we extract perceptually heterogeneous features by proposed multi-channel natural video statistics (MNVS) model, which are characterized 3D video information. Furthermore, a robust AdaBoosting Radial Basis Function (RBF) neural network is utilized to map the features to the overall quality of 3D video. On two benchmark databases, the extensive evaluations demonstrate that the proposed algorithm significantly outperforms several state-of-the-art quality metrics in term of prediction accuracy and robustness. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:298 / 304
页数:7
相关论文
共 50 条
  • [1] Blind quality assessment for 3D synthesised video with binocular asymmetric distortion
    Cui, Shuainan
    Peng, Zongju
    Chen, Fen
    Zou, Wenhui
    Jiang, Gangyi
    Yu, Mei
    IET IMAGE PROCESSING, 2020, 14 (06) : 1027 - 1034
  • [2] Objective Quality Assessment of Stereoscopic Video Using Inflated 3D Features
    Hassan Imani
    Md Baharul Islam
    SN Computer Science, 5 (6)
  • [3] PERCEPTUAL VIDEO QUALITY METRIC FOR 3D VIDEO QUALITY ASSESSMENT
    Joveluro, P.
    Malekmohamadi, H.
    Fernando, W. A. C.
    Kondoz, A. M.
    2010 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON 2010), 2010,
  • [4] 3D Perception Algorithms: Towards Perceptually Driven Compression of 3D Video
    Ruimin Hu
    Rui Zhong
    Zhongyuan Wang
    Zhen Han
    ZTECommunications, 2013, 11 (01) : 11 - 16
  • [5] Quality assessment of adaptive 3D video streaming
    Tavakoli, Samira
    Gutierrez, Jesus
    Garcia, Narciso
    THREE-DIMENSIONAL IMAGE PROCESSING (3DIP) AND APPLICATIONS 2013, 2013, 8650
  • [6] Crowdsourced subjective 3D video quality assessment
    Emil Dumic
    Kresimir Sakic
    Luis A. da Silva Cruz
    Multimedia Systems, 2019, 25 : 673 - 694
  • [7] Subjective Quality Assessment of Compressed 3D Video
    Tian, Tian
    Jiang, Xiuhua
    Du, Xiangkun
    2014 7TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP 2014), 2014, : 606 - 611
  • [8] Crowdsourced subjective 3D video quality assessment
    Dumic, Emil
    Sakic, Kresimir
    da Silva Cruz, Luis A.
    MULTIMEDIA SYSTEMS, 2019, 25 (06) : 673 - 694
  • [9] Jointly Learning Heterogeneous Features for RGB-D Activity Recognition
    Hu, Jian-Fang
    Zheng, Wei-Shi
    Lai, Jianhuang
    Zhang, Jianguo
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 5344 - 5352
  • [10] Jointly Learning Heterogeneous Features for RGB-D Activity Recognition
    Hu, Jian-Fang
    Zheng, Wei-Shi
    Lai, Jianhuang
    Zhang, Jianguo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (11) : 2186 - 2200