Jointly learning perceptually heterogeneous features for blind 3D video quality assessment

被引:10
|
作者
Wang, Yongfang [1 ,2 ]
Shuai, Yuan [1 ]
Zhu, Yun [1 ]
Zhang, Jian [3 ]
An, Ping [1 ,2 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Univ Technol Sydney, Global Big Data Technol Ctr, Sydney, NSW 2007, Australia
关键词
Blind quality metric; Binocular spatio-temporal internal generative mechanism; Multi-channel natural video statistics; AdaBoosting radial basis function (RBF) neural network; SIMILARITY; IMAGES;
D O I
10.1016/j.neucom.2018.12.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D videos quality assessment (3D-VQA) is essential to various 3D video processing applications. However, it has not been well investigated on how to make use of perceptual multi-channel video information to improve 3D-VQA under different distortion categories and degrees, especially under asymmetrical distortions. In the paper, we propose a new blind 3D-VQA metric by jointly learning perceptually heterogeneous features. Firstly, a binocular spatio-temporal internal generative mechanism (BST-IGM) is proposed to decompose the views of 3D video into multi-channel videos. Then, we extract perceptually heterogeneous features by proposed multi-channel natural video statistics (MNVS) model, which are characterized 3D video information. Furthermore, a robust AdaBoosting Radial Basis Function (RBF) neural network is utilized to map the features to the overall quality of 3D video. On two benchmark databases, the extensive evaluations demonstrate that the proposed algorithm significantly outperforms several state-of-the-art quality metrics in term of prediction accuracy and robustness. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:298 / 304
页数:7
相关论文
共 50 条
  • [31] Quality Assessment of Synthesized 3D Video with Distorted Depth Map
    Liu, Hsin-Che
    Hang, Hsueh-Ming
    2014 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2014, : 1054 - 1057
  • [32] Quality Assessment of 3D Video Based on Visual Salient Regions
    You Antong
    Jiang Xiuhua
    Lei Xiaohua
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 2, 2016, : 277 - 280
  • [33] PERFORMANCE COMPARISON OF SUBJECTIVE ASSESSMENT METHODS FOR 3D VIDEO QUALITY
    Kawano, Taichi
    Yamagishi, Kazuhisa
    Hayashi, Takanori
    2012 FOURTH INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2012, : 218 - 223
  • [34] 3D OBJECTIVE QUALITY ASSESSMENT OF LIGHT FIELD VIDEO FRAMES
    Tamboli, Roopak R.
    Kara, Peter A.
    Cserkaszky, Aron
    Barsi, Attila
    Martini, Maria G.
    Appina, Balasubramanyam
    Channappayya, Sumohana S.
    Jana, Soumya
    2018 - 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2018,
  • [35] A Novel 3D Video Transcoding Scheme for Adaptive 3D Video Transmission to Heterogeneous Terminals
    Liu, Shujie
    Chen, Chang Wen
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2012, 8 (03)
  • [36] Heterogeneous Features Fusion with Collaborative Representation Learning for 3D Action Recognition
    Liang, Chengwu
    Chen, Enqing
    Qi, Lin
    Guan, Ling
    2017 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2017, : 162 - 168
  • [37] Perceptually optimized 3D graphics
    Reddy, M
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2001, 21 (05) : 68 - 75
  • [38] A Survey on 3D Quality of Experience and 3D Quality Assessment
    Moorthy, Anush K.
    Bovik, Alan C.
    HUMAN VISION AND ELECTRONIC IMAGING XVIII, 2013, 8651
  • [39] DEEP LEARNING FOR OBJECTIVE QUALITY ASSESSMENT OF 3D IMAGES
    Mocanu, Decebal Constantin
    Exarchakos, Georgios
    Liotta, Antonio
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 758 - 762
  • [40] Jointly Training of Binary 3D CNN Features for Action Recognition
    Cai, Yangang
    Xing, Peiyin
    Wang, Zhenyu
    Wang, Ronggang
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 446 - 446