Perceptual Quality Assessment of Video Considering Both Frame Rate and Quantization Artifacts

被引:119
|
作者
Ou, Yen-Fu [1 ]
Ma, Zhan [1 ]
Liu, Tao [2 ]
Wang, Yao [1 ]
机构
[1] NYU, Polytech Inst, Brooklyn, NY 11201 USA
[2] Dial Res Inc, Eatontown, NJ 07724 USA
基金
美国国家科学基金会;
关键词
Content features; frame rate; scalable video; video quality model; BIT-RATE; IMPACT;
D O I
10.1109/TCSVT.2010.2087833
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we explore the impact of frame rate and quantization on perceptual quality of a video. We propose to use the product of a spatial quality factor that assesses the quality of decoded frames without considering the frame rate effect and a temporal correction factor, which reduces the quality assigned by the first factor according to the actual frame rate. We find that the temporal correction factor follows closely an inverted falling exponential function, whereas the quantization effect on the coded frames can be captured accurately by a sigmoid function of the peak signal-to-noise ratio. The proposed model is analytically simple, with each function requiring only a single content-dependent parameter. The proposed overall metric has been validated using both our subjective test scores as well as those reported by others. For all seven data sets examined, our model yields high Pearson correlation (higher than 0.9) with measured mean opinion score (MOS). We further investigate how to predict parameters of our proposed model using content features derived from the original videos. Using predicted parameters from content features, our model still fits with measured MOS with high correlation.
引用
收藏
页码:286 / 298
页数:13
相关论文
共 50 条
  • [1] PERCEPTUAL QUALITY ASSESSMENT OF HIGH FRAME RATE VIDEO
    Nasiri, Rasoul Mohammadi
    Wang, Jiheng
    Rehman, Abdul
    Wang, Shiqi
    Wang, Zhou
    2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
  • [2] Modeling Rate and Perceptual Quality of Scalable Video as Functions of Quantization and Frame Rate and Its Application in Scalable Video Adaptation
    Wang, Yao
    Ma, Zhan
    Ou, Yen-Fu
    PV: 2009 17TH INTERNATIONAL PACKET VIDEO WORKSHOP, 2009, : 194 - 202
  • [3] Frame Rate and Perceptual Quality for HD Video
    Liu, Yutao
    Zhai, Guangtao
    Zhao, Debin
    Liu, Xianming
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2015, PT II, 2015, 9315 : 497 - 505
  • [4] Modeling of Rate and Perceptual Quality of Compressed Video as Functions of Frame Rate and Quantization Stepsize and Its Applications
    Ma, Zhan
    Xu, Meng
    Ou, Yen-Fu
    Wang, Yao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (05) : 671 - 682
  • [5] Perceptual Quality Maximization for Video Calls With Packet Losses by Optimizing FEC, Frame Rate, and Quantization
    Kurdoglu, Eymen
    Liu, Yong
    Wang, Yao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (07) : 1876 - 1887
  • [6] MODELING THE IMPACT OF FRAME RATE ON PERCEPTUAL QUALITY OF VIDEO
    Ou, Yen-Fu
    Liu, Tao
    Zhao, Zhi
    Ma, Zhan
    Wang, Yao
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 689 - 692
  • [7] PERCEPTUAL ALIASING FACTORS AND THE IMPACT OF FRAME RATE ON VIDEO QUALITY
    Nasiri, Rasoul Mohammadi
    Wang, Zhou
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3475 - 3479
  • [8] PERCEPTUAL QUALITY OF VIDEO WITH FRAME RATE VARIATION : A SUBJECTIVE STUDY
    Ou, Yen-Fu
    Zhou, Yan
    Wang, Yao
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 2446 - 2449
  • [9] A Novel Video Quality Metric for Low Bit-Rate Video Considering Both Coding and Packet-Loss Artifacts
    Liu, Tao
    Wang, Yao
    Boyce, Jill M.
    Yang, Hua
    Wu, Zhenyu
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2009, 3 (02) : 280 - 293
  • [10] PERCEPTUAL QUALITY MEASUREMENT OF VIDEO FRAMES AFFECTED BY BOTH PACKET LOSSES AND CODING ARTIFACTS
    Tao Liu
    Hua Yang
    Alan Stein
    Yao Wang
    QOMEX: 2009 INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE, 2009, : 210 - +