Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing

被引:268
|
作者
Soundararajan, Rajiv [1 ]
Bovik, Alan C. [1 ]
机构
[1] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
基金
美国国家科学基金会;
关键词
Entropy; human visual system; motion information; natural video statistics; reduced reference video quality assessment; SPEED; MODEL;
D O I
10.1109/TCSVT.2012.2214933
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We present a family of reduced reference video quality assessment (QA) models that utilize spatial and temporal entropic differences. We adopt a hybrid approach of combining statistical models and perceptual principles to design QA algorithms. A Gaussian scale mixture model for the wavelet coefficients of frames and frame differences is used to measure the amount of spatial and temporal information differences between the reference and distorted videos, respectively. The spatial and temporal information differences are combined to obtain the spatio-temporal-reduced reference entropic differences. The algorithms are flexible in terms of the amount of side information required from the reference that can range between a single scalar per frame and the entire reference information. The spatio-temporal entropic differences are shown to correlate quite well with human judgments of quality, as demonstrated by experiments on the LIVE video quality assessment database.
引用
收藏
页码:684 / 694
页数:11
相关论文
共 50 条
  • [31] TEMPORAL MOTION SMOOTHNESS MEASUREMENT FOR REDUCED-REFERENCE VIDEO QUALITY ASSESSMENT
    Zeng, Kai
    Wang, Zhou
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 1010 - 1013
  • [32] ANALYSIS OF VIDEO QUALITY INDUCED SPATIO-TEMPORAL SALIENCY SHIFTS
    Wu, Xinbo
    Dong, Zhengyan
    Zhang, Fan
    Rosin, Paul L.
    Liu, Hantao
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1581 - 1585
  • [33] Using multiple spatio-temporal features to estimate video quality
    Freitas, Pedro Garcia
    Akamine, Welington Y. L.
    Farias, Mylene C. Q.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 64 : 1 - 10
  • [34] Spatio-Temporal Deformable Convolution for Compressed Video Quality Enhancement
    Deng, Jianing
    Wang, Li
    Pu, Shiliang
    Zhuo, Cheng
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 10696 - 10703
  • [35] Quality of Experience Evaluation Model with No-Reference VMAF Metric and Deep Spatio-temporal Features of Video
    Du, Lina
    Yang, Shuo
    Zhuo, Li
    Zhang, Hui
    Zhang, Jing
    Li, Jiafeng
    SENSING AND IMAGING, 2022, 23 (01):
  • [36] Extraction of Spatio-Temporal Features based on a Hardware Approach for a No-Reference Objective Video Quality Metric
    de Oliveira, Marcelo
    Viana da Silva, Caio Cesar
    da Silva, Wyllian Bezerra
    Jasinski, Ricardo
    Pedroni, Volnei Antonio
    Prado Pohl, Alexandre de Almeida
    2016 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2016,
  • [37] Annoyance of spatio-temporal artifacts in segmentation quality assessment
    Gelasca, EDG
    Ebrahimi, T
    Farias, MCQ
    Carli, MC
    Mitra, SK
    ICIP: 2004 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1- 5, 2004, : 345 - 348
  • [38] Quality of Experience Evaluation Model with No-Reference VMAF Metric and Deep Spatio-temporal Features of Video
    Lina Du
    Shuo Yang
    Li Zhuo
    Hui Zhang
    Jing Zhang
    Jiafeng Li
    Sensing and Imaging, 2022, 23
  • [39] The Impact of Temporal Pooling and Spatio-Temporal Quality Interaction on the Prediction Accuracy of Video Quality Metrics
    Wulf, Steffen
    Zoelzer, Udo
    2013 SIGNAL PROCESSING: ALGORITHMS, ARCHITECTURES, ARRANGEMENTS, AND APPLICATIONS (SPA), 2013, : 26 - 31
  • [40] Video Segmentation with Spatio-Temporal Tubes
    Trichet, Remi
    Nevatia, Ramakant
    2013 10TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2013), 2013, : 330 - 335