Real-Time Monitoring of Video Quality in a DASH-based Digital Video Broadcasting using Deep Learning

被引:2
|
作者
Motaung, William [1 ]
Ogudo, Kingsley A. [1 ]
Chabalala, Chabalala [2 ]
机构
[1] Univ Johannesburg, Dept Elect & Elect Engn, Johannesburg, South Africa
[2] Univ Witwatersrand, Sch Elect & Informat Engn, Johannesburg, South Africa
关键词
deep learning; digital video broadcasting; multimedia streaming; restricted Boltzmann machine; video quality assessment;
D O I
10.1109/icABCD54961.2022.9856390
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Digital video processing and transmission can introduce numerous distortions while capturing signals from broadcasting stations. These distortions become a nightmare for multimedia companies, especially terrestrial broadcasting companies that have fully adopted the online video streaming service. While terrestrial broadcasting benefits from online streaming through over-the-top (OTT) channels, there is a potential setback to reducing the video quality due to preprocessing of signals. Video quality assessment (VQA) algorithms have been developed for analyzing the quality of videos in a database, but little attention has been paid to implementing such algorithms in a real-time situation. This paper develops a novel real-time VQA framework by integrating a deep learning technology into the broadcasting pipeline. Previous studies used objective metrics augmented with subjective values to validate techniques. However, this approach is not appropriate for real-time video evaluation. Our proposed framework uses objective metrics (devoid of subjective scores like mean opinion scores) but rather introduced a new metric to validate the framework. The whole framework is validated using compressed/uncompressed signals and varying devices to show the signal differences. Results show that the framework is a step toward feasible incorporation of a VQA tool in a digital terrestrial television model. Using 100 epochs for our simulated video stream, the restricted Boltzmann machine yields a root mean square and mean absolute of 3.6903 and 2.3861 respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] QoE Estimation of DASH-Based Mobile Video Application Using Deep Reinforcement Learning
    Hou, Biao
    Zhang, Junxing
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2020, PT II, 2020, 12453 : 633 - 645
  • [2] Real-Time QoE Estimation of DASH-based Mobile Video Applications through Edge Computing
    Ge, Chang
    Wang, Ning
    [J]. IEEE INFOCOM 2018 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2018, : 766 - 771
  • [3] Real-time video quality monitoring
    Liu, Tao
    Narvekar, Niranjan
    Wang, Beibei
    Ding, Ran
    Zou, Dekun
    Cash, Glenn
    Bhagavathy, Sitaram
    Bloom, Jeffrey
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2011, : 1 - 18
  • [4] Real-time video quality monitoring
    Tao Liu
    Niranjan Narvekar
    Beibei Wang
    Ran Ding
    Dekun Zou
    Glenn Cash
    Sitaram Bhagavathy
    Jeffrey Bloom
    [J]. EURASIP Journal on Advances in Signal Processing, 2011
  • [5] Real-time audio/video decoders for digital multimedia broadcasting
    Ha, VHS
    Choi, SK
    Jeon, JG
    Lee, GH
    Jang, WK
    Shim, WS
    [J]. 4TH IEEE INTERNATIONAL WORKSHOP ON SYSTEM-ON-CHIP FOR REAL-TIME APPLICATIONS, PROCEEDINGS, 2004, : 162 - 167
  • [6] QARC: Video Quality Aware Rate Control for Real-Time Video Streaming based on Deep Reinforcement Learning
    Huang, Tianchi
    Zhang, Rui-Xiao
    Zhou, Chao
    Sun, Lifeng
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1208 - 1216
  • [7] Real-time Traffic Analysis Using Deep Learning Techniques And UAV Based Video
    Zhang, Huaizhong
    Liptrott, Mark
    Bessis, Nik
    Cheng, Jianquan
    [J]. 2019 16TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2019,
  • [8] Measuring and Predicting Quality of Experience of DASH-based Video Streaming Over LTE
    Jia, Kaikai
    Guo, Yuchun
    Chen, Yishuai
    Zhao, Yongxiang
    [J]. 2016 19TH INTERNATIONAL SYMPOSIUM ON WIRELESS PERSONAL MULTIMEDIA COMMUNICATIONS (WPMC), 2016,
  • [9] Distributed Embedded Deep Learning based Real-time Video Processing
    Zhang, Weishan
    Zhao, Dehai
    Xu, Liang
    Li, Zhongwei
    Gong, Wenjuan
    Zhou, Jiehan
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 1945 - 1950
  • [10] Real-time Video Quality Assessment for China Mobile Multimedia Broadcasting
    Shi, Hui
    Jiang, Xiuhua
    [J]. 2012 7TH INTERNATIONAL CONFERENCE ON COMPUTING AND CONVERGENCE TECHNOLOGY (ICCCT2012), 2012, : 244 - 248