No-Reference Video Quality Assessment Using the Temporal Statistics of Global and Local Image Features

被引:2
|
作者
Varga, Domonkos [1 ]
机构
[1] Ronin Inst, Montclair, NJ 07043 USA
关键词
no-reference video quality assessment; quality-aware features; multi-feature fusion; PREDICTION; MODEL;
D O I
10.3390/s22249696
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
During acquisition, storage, and transmission, the quality of digital videos degrades significantly. Low-quality videos lead to the failure of many computer vision applications, such as object tracking or detection, intelligent surveillance, etc. Over the years, many different features have been developed to resolve the problem of no-reference video quality assessment (NR-VQA). In this paper, we propose a novel NR-VQA algorithm that integrates the fusion of temporal statistics of local and global image features with an ensemble learning framework in a single architecture. Namely, the temporal statistics of global features reflect all parts of the video frames, while the temporal statistics of local features reflect the details. Specifically, we apply a broad spectrum of statistics of local and global features to characterize the variety of possible video distortions. In order to study the effectiveness of the method introduced in this paper, we conducted experiments on two large benchmark databases, i.e., KoNViD-1k and LIVE VQC, which contain authentic distortions, and we compared it to 14 other well-known NR-VQA algorithms. The experimental results show that the proposed method is able to achieve greatly improved results on the considered benchmark datasets. Namely, the proposed method exhibits significant progress in performance over other recent NR-VQA approaches.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] No-Reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics
    Li, Yanqing
    Hu, Xinping
    2017 2ND INTERNATIONAL CONFERENCE ON MULTIMEDIA AND IMAGE PROCESSING (ICMIP), 2017, : 123 - 127
  • [22] No-reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics
    Appina, Balasubramanyam
    Khan, Sameeulla
    Channappayya, Sumohana S.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 43 : 1 - 14
  • [23] No-Reference Video Quality Assessment Using Distortion Learning and Temporal Attention
    Kossi, Koffi
    Coulombe, Stephane
    Desrosiers, Christian
    Gagnon, Ghyslain
    IEEE ACCESS, 2022, 10 : 41010 - 41022
  • [24] Local Binary Patterns and Neural Networks for No-Reference Image and Video Quality Assessment
    Panic, Marko
    Culibrk, Dubravko
    Sladojevic, Srdjan
    Crnojevic, Vladimir
    ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EANN 2013, PT I, 2013, 383 : 388 - 395
  • [25] No-reference Mobile Video Quality Assessment Based on Video Natural Statistics
    Shi Wenjuan
    Sun Yanjing
    Zuo Haiwei
    Cao Qi
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (01) : 143 - 150
  • [26] No-reference video quality assessment method based on spatio-temporal features using the ELM algorithm
    da Silva, Wyllian Bezerra
    Mikowski, Alexandre
    Casali, Rafael Machado
    IET IMAGE PROCESSING, 2020, 14 (07) : 1316 - 1326
  • [27] No-Reference Quality Assessment of Authentically Distorted Images Based on Local and Global Features
    Varga, Domonkos
    JOURNAL OF IMAGING, 2022, 8 (06)
  • [28] NO-REFERENCE QUALITY ASSESSMENT OF STEREOSCOPIC IMAGES BASED ON BINOCULAR COMBINATION OF LOCAL FEATURES STATISTICS
    Fan, Yu
    Larabi, Mohamed-Chaker
    Cheikh, Faouzi Alaya
    Fernandez-Maloigne, Christine
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3538 - 3542
  • [29] No-reference image quality assessment with local features and high-order derivatives
    Oszust, Mariusz
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 56 : 15 - 26
  • [30] NO-REFERENCE STEREOSCOPIC IMAGE QUALITY ASSESSMENT BASED ON LOCAL TO GLOBAL FEATURE REGRESSION
    Li, Sumei
    Xue, Jianwei
    Han, Yongtian
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 448 - 453