Spatio-temporal Quality Pooling Adaptive to Distortion Distribution and Visual Attention

被引:0
|
作者
Li, Yichen [1 ]
Guo, Xiaoqiang [2 ]
Wang, Haiying [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] SAPPRIT, Acad Broadcasting Sci, Beijing, Peoples R China
来源
2015 VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP) | 2015年
关键词
Spatio-temporal pooling; uniformity of distortion distribution; visual attention; memory effect; quality assessment;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose an adaptive spatio-temporal quality pooling scheme for video quality assessment (VQA) considering the uniformity of distortion distribution and visual attention. A uniformity index is defined according to the distribution of localized distortions in one frame, and is utilized to generate a saliency map from the visual attention model, to incorporate temporal memory effect, and to adaptively pool the localized spatio-temporal quality indices. The proposed scheme outperforms the traditional mean-based pooling scheme and shows competitive performance against well-known VQA algorithms when tested on two publicly available video quality databases.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Spatio-Temporal Attention Pooling for Audio Scene Classification
    Phan, Huy
    Chen, Oliver Y.
    Pham, Lam
    Koch, Philipp
    De Vos, Maarten
    McLoughlin, Ian
    Mertins, Alfred
    INTERSPEECH 2019, 2019, : 3845 - 3849
  • [2] The mechanism of visual attention is the spatio-temporal salience map
    Sperling, G
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 1996, 31 (3-4) : 3366 - 3366
  • [3] A spatio-temporal model of the selective human visual attention
    Le Meur, O
    Thoreau, D
    Le Callet, P
    Barba, D
    2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 3201 - 3204
  • [4] Visual extinction as a spatio-temporal disorder of selective attention
    di Pellegrino, G
    Basso, G
    Frassinetti, F
    NEUROREPORT, 1998, 9 (05) : 835 - 839
  • [5] Diverse Video Captioning by Adaptive Spatio-temporal Attention
    Ghaderi, Zohreh
    Salewski, Leonard
    Lensch, Hendrik P. A.
    PATTERN RECOGNITION, DAGM GCPR 2022, 2022, 13485 : 409 - 425
  • [6] Adaptive Pooling of the Most Relevant Spatio-Temporal Features for Action Recognition
    Ahmed, Faisal
    Paul, Padma Polash
    Gavrilova, Marina
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2016, : 177 - 180
  • [7] The Impact of Temporal Pooling and Spatio-Temporal Quality Interaction on the Prediction Accuracy of Video Quality Metrics
    Wulf, Steffen
    Zoelzer, Udo
    2013 SIGNAL PROCESSING: ALGORITHMS, ARCHITECTURES, ARRANGEMENTS, AND APPLICATIONS (SPA), 2013, : 26 - 31
  • [8] Adaptive spatio-temporal context learning for visual tracking
    Zhang, Yaqin
    Wang, Liejun
    Qin, Jiwei
    IMAGING SCIENCE JOURNAL, 2019, 67 (03): : 136 - 147
  • [9] SPATIO-TEMPORAL QUALITY POOLING ACCOUNTING FOR TRANSIENT SEVERE IMPAIRMENTS AND EGOMOTION
    Park, Jincheol
    Seshadrinathan, Kalpana
    Lee, Sanghoon
    Bovik, Alan C.
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [10] LEARNING SPATIO-TEMPORAL REPRESENTATIONS WITH TEMPORAL SQUEEZE POOLING
    Huang, Guoxi
    Bors, Adrian G.
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2103 - 2107