A video structural similarity quality metric based on a joint spatial-temporal visual attention model

被引:1
|
作者
Zhang, Hua [1 ]
Tian, Xiang [1 ]
Chen, Yao-wu [1 ]
机构
[1] Zhejiang Univ, Inst Adv Digital Technol & Instrumentat, Hangzhou 310027, Zhejiang, Peoples R China
来源
关键词
Quality assessment; Structural similarity (SSIM) index; Attended region; Visual attention shift;
D O I
10.1631/jzus.A0920035
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Objective video quality assessment plays a very important role in multimedia signal processing. Several extensions of the structural similarity (SSIM) index could not predict the quality of the video sequence effectively. In this paper we propose a structural similarity quality metric for videos based on a spatial-temporal visual attention model. This model acquires the motion attended region and the distortion attended region by computing the motion features and the distortion contrast. It mimics the visual attention shifting between the two attended regions and takes the burst of error into account by introducing the non-linear weighting functions to give a much higher weighting factor to the extremely damaged frames. The proposed metric based on the model renders the final object quality rating of the whole video sequence and is validated using the 50 Hz video sequences of Video Quality Experts Group Phase I test database.
引用
收藏
页码:1696 / 1704
页数:9
相关论文
共 50 条
  • [2] A video structural similarity quality metric based on a joint spatial-temporal visual attention model
    Hua Zhang
    Xiang Tian
    Yao-wu Chen
    [J]. Journal of Zhejiang University-SCIENCE A, 2009, 10 : 1696 - 1704
  • [3] Spatial-Temporal Visual Attention Model for Video Quality Assessment
    Suen, Wei-Juen
    Liu, Hsin-Hua
    Pei, Soo-Chang
    Liu, Kuan-Hsien
    Liu, Tsung-Jung
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
  • [4] Spatial-temporal video quality metric based on an estimation of QoE
    Amirshahi, S. A.
    Larabi, M-C
    [J]. 2011 THIRD INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2011, : 84 - 89
  • [5] STEREOSCOPIC VIDEO QUALITY ASSESSMENT MODEL BASED ON SPATIAL-TEMPORAL STRUCTURAL INFORMATION
    Han, Jingjing
    Jiang, Tingting
    Ma, Siwei
    [J]. 2012 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2012,
  • [6] Using Spatial-Temporal Attention for Video Quality Evaluation
    Chi, Biwei
    Su, Ruifang
    Chen, Xinhui
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [7] SPATIAL-TEMPORAL VIDEO BROWSING FOR MOBILE ENVIRONMENT BASED ON VISUAL ATTENTION ANALYSIS
    Qiu, Xuekan
    Jiang, Shuqiang
    Huang, Qingming
    Liu, Huiying
    [J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1282 - +
  • [8] Video Description with Spatial-Temporal Attention
    Tu, Yunbin
    Zhang, Xishan
    Liu, Bingtao
    Yan, Chenggang
    [J]. PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1014 - 1022
  • [9] Objective Quality Metric Based on Spatial-temporal Distortion
    Yang, Chunting
    Liu, Yang
    Yu, Jing
    [J]. 2008 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND INFORMATION TECHNOLOGY, PROCEEDINGS, 2008, : 813 - +
  • [10] Visual Attention Modeling for Video Quality Assessment With Structural Similarity
    Fu, Bin
    Lu, Zhaoming
    Wen, Xiangming
    Wang, Luhan
    Shao, Hua
    [J]. 2013 16TH INTERNATIONAL SYMPOSIUM ON WIRELESS PERSONAL MULTIMEDIA COMMUNICATIONS (WPMC), 2013,