Motion Trajectory based Spatial-Temporal Degradation Measurement for Video Quality Assessment

被引:0
|
作者
Wu, Jinjian [1 ]
Liu, Yongxu [1 ]
Shi, Guangming [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Xian, Shaanxi, Peoples R China
关键词
Video Quality Assessment; Motion Trajectory; Optical Flow; Spatial-Temporal Quality Degradation; IMAGE; SIMILARITY; MODEL;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid growth of digital video through the Internet, a reliable video quality assessment (VQA) technology is greatly demanded for video management. Motion information plays a dominant role for video perception, however it is too difficult to be accurately analyzed for VQA. The human visual system (HVS) is highly adaptive to track moving objects with pursuit eye movement. Inspired by the motion process in the HVS, we suggest to analyze the degradation along attended motion trajectories for VQA. As a convenient representation of motion, optical flow is calculated for motion trajectory searching. Next, the degradation on the motion velocity along each trajectory is analyzed with the optical flow for temporal quality measurement. Meanwhile, visual information along each trajectory is extracted for joint spatial-temporal quality measurement. Finally, considering the spatial quality degradation from each frame, a novel VQA model is introduced. Experimental results on the public available VQA databases demonstrate that the proposed VQA model performs highly consistency with the subjective perception.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Video Quality Assessment Based on Spatial-temporal Distortion
    Yang, Chunting
    Liu, Yang
    Yu, Jing
    [J]. PROCEEDINGS OF THE FIRST INTERNATIONAL WORKSHOP ON EDUCATION TECHNOLOGY AND COMPUTER SCIENCE, VOL I, 2009, : 818 - +
  • [2] SPATIAL-TEMPORAL VIDEO QUALITY ASSESSMENT BASED ON TWO-LEVEL TEMPORAL POOLING
    Yang, Fuzheng
    Wan, Shuai
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2011, 11 (02) : 235 - 249
  • [3] Spatial-Temporal Correlation for Trajectory based Action Video Retrieval
    Shen, Xi
    Zhang, Lelin
    Wang, Zhiyong
    Feng, Dagan
    [J]. 2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
  • [4] No-Reference Stereoscopic Video Quality Assessment Based on Spatial-Temporal Statistics
    Zhang, Jiufa
    Liu, Lixiong
    Gong, Jiachao
    Huang, Hua
    [J]. IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 83 - 94
  • [5] STEREOSCOPIC VIDEO QUALITY ASSESSMENT MODEL BASED ON SPATIAL-TEMPORAL STRUCTURAL INFORMATION
    Han, Jingjing
    Jiang, Tingting
    Ma, Siwei
    [J]. 2012 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2012,
  • [6] Spatial-Temporal Visual Attention Model for Video Quality Assessment
    Suen, Wei-Juen
    Liu, Hsin-Hua
    Pei, Soo-Chang
    Liu, Kuan-Hsien
    Liu, Tsung-Jung
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
  • [7] Spatial-Temporal Motion Compensation Based Video Super Resolution
    An, Yaozu
    Lu, Yao
    Yan, Ziye
    [J]. COMPUTER VISION - ACCV 2010, PT II, 2011, 6493 : 282 - 292
  • [8] Exploiting spatial-temporal context for trajectory based action video retrieval
    Zhang, Lelin
    Wang, Zhiyong
    Yao, Tingting
    Staoh, Shin'ichi
    Mei, Tao
    Feng, David Dagan
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (02) : 2057 - 2081
  • [9] Exploiting spatial-temporal context for trajectory based action video retrieval
    Lelin Zhang
    Zhiyong Wang
    Tingting Yao
    Shin’ichi Staoh
    Tao Mei
    David Dagan Feng
    [J]. Multimedia Tools and Applications, 2018, 77 : 2057 - 2081
  • [10] Spatial-temporal video quality metric based on an estimation of QoE
    Amirshahi, S. A.
    Larabi, M-C
    [J]. 2011 THIRD INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2011, : 84 - 89