Jointly learning perceptually heterogeneous features for blind 3D video quality assessment

被引:10
|
作者
Wang, Yongfang [1 ,2 ]
Shuai, Yuan [1 ]
Zhu, Yun [1 ]
Zhang, Jian [3 ]
An, Ping [1 ,2 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Univ Technol Sydney, Global Big Data Technol Ctr, Sydney, NSW 2007, Australia
关键词
Blind quality metric; Binocular spatio-temporal internal generative mechanism; Multi-channel natural video statistics; AdaBoosting radial basis function (RBF) neural network; SIMILARITY; IMAGES;
D O I
10.1016/j.neucom.2018.12.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D videos quality assessment (3D-VQA) is essential to various 3D video processing applications. However, it has not been well investigated on how to make use of perceptual multi-channel video information to improve 3D-VQA under different distortion categories and degrees, especially under asymmetrical distortions. In the paper, we propose a new blind 3D-VQA metric by jointly learning perceptually heterogeneous features. Firstly, a binocular spatio-temporal internal generative mechanism (BST-IGM) is proposed to decompose the views of 3D video into multi-channel videos. Then, we extract perceptually heterogeneous features by proposed multi-channel natural video statistics (MNVS) model, which are characterized 3D video information. Furthermore, a robust AdaBoosting Radial Basis Function (RBF) neural network is utilized to map the features to the overall quality of 3D video. On two benchmark databases, the extensive evaluations demonstrate that the proposed algorithm significantly outperforms several state-of-the-art quality metrics in term of prediction accuracy and robustness. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:298 / 304
页数:7
相关论文
共 50 条
  • [21] Spatiotemporal Representation Learning for Blind Video Quality Assessment
    Liu, Yongxu
    Wu, Jinjian
    Li, Leida
    Dong, Weisheng
    Zhang, Jinpeng
    Shi, Guangming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3500 - 3513
  • [22] 3D Video Quality Assessment Based on Visual Perception
    Lee, Pei-Jun
    Yang, Hao-Po
    Hsu, Chen-Chien
    2017 IEEE 6TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE), 2017,
  • [23] Saliency inspired quality assessment of stereoscopic 3D video
    Banitalebi-Dehkordi, Amin
    Nasiopoulos, Panos
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (19) : 26055 - 26082
  • [24] Saliency inspired quality assessment of stereoscopic 3D video
    Amin Banitalebi-Dehkordi
    Panos Nasiopoulos
    Multimedia Tools and Applications, 2018, 77 : 26055 - 26082
  • [25] Perceptually Driven Nonuniform Asymmetric Coding of Stereoscopic 3D Video
    Fezza, Sid Ahmed
    Larabi, Mohamed-Chaker
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (10) : 2231 - 2245
  • [26] Objective Quality Assessment of 3D Stereoscopic Video Based on Motion Vectors and Depth Map Features
    Mahmood, Sawsen Abdulhadi
    Ghani, Rana Fareed
    2015 7TH COMPUTER SCIENCE AND ELECTRONIC ENGINEERING CONFERENCE (CEEC), 2015, : 179 - 183
  • [27] COMBINATION OF HANDCRAFTED AND DEEP LEARNING-BASED FEATURES FOR 3D MESH QUALITY ASSESSMENT
    Abouelaziz, Ilyass
    Chetouani, Aladine
    El Hassouni, Mohammed
    Latecki, Longin Jan
    Cherifi, Hocine
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 171 - 175
  • [28] Stereoscopic 3D video quality assessment based on depth maps and video motion
    Juan Pedro López
    Juan Antonio Rodrigo
    David Jiménez
    José Manuel Menéndez
    EURASIP Journal on Image and Video Processing, 2013
  • [29] Stereoscopic 3D video quality assessment based on depth maps and video motion
    Pedro Lopez, Juan
    Antonio Rodrigo, Juan
    Jimenez, David
    Manuel Menendez, Jose
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2013,
  • [30] Subjective Quality Assessment Methodology for 3D Video Compression Technology
    Lewandowski, Filip
    Paluszkiewicz, Mateusz
    Grajek, Tomasz
    Wegner, Krzysztof
    2012 INTERNATIONAL CONFERENCE ON SIGNALS AND ELECTRONIC SYSTEMS (ICSES), 2012,