QoE Estimation of DASH-Based Mobile Video Application Using Deep Reinforcement Learning

被引:2
|
作者
Hou, Biao [1 ]
Zhang, Junxing [1 ]
机构
[1] Inner Mongolia Univ, Hohhot, Peoples R China
基金
中国国家自然科学基金;
关键词
MPEG-DASH protocol; ABR algorithm; QoE model; DQN algorithm;
D O I
10.1007/978-3-030-60239-0_43
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
An increasing number of video content providers have adopted adaptive bitrate (ABR) streaming via the HTTP protocol. The client players usually run an ABR algorithm to determine the optimal quality of video playback in the next few seconds. Faced with unpredictable bandwidth variability, the latest ABR algorithm attempts to achieve the best balance between competing goals of high bitrate, less rebuffering and high smoothness. However, there is no guarantee that optimal resource utilization ensures a high quality of experience (QoE). QoE is also affected by users' preferences for video content. Even for the same movie clip, different users have varied preferences for characters, scenes, plots and other content. In this paper, we propose a Deep-Q Learning Network (DQN) based ABR algorithm to optimize the use of network and client resources in video playback and also improve QoE of users.
引用
收藏
页码:633 / 645
页数:13
相关论文
共 50 条
  • [31] Intent-based Control Loop for DASH Video Service Assurance using ML-based Edge QoE Estimation
    Rothenberg, Christian Esteve
    Lachos Perez, Danny A.
    Saraiva de Sousa, Nathan F.
    Rosa, Raphael V.
    Ul Mustafa, Raza
    Islam, Md Tariqul
    Gomes, Pedro Henrique
    [J]. PROCEEDINGS OF THE 2020 6TH IEEE CONFERENCE ON NETWORK SOFTWARIZATION (NETSOFT 2020): BRIDGING THE GAP BETWEEN AI AND NETWORK SOFTWARIZATION, 2020, : 353 - 355
  • [32] A QoE Inference Method for DASH Video Using ICMP Probing
    Miranda, Gilson, Jr.
    Macedo, Daniel Fernandes
    Marquez-Barja, Johann M.
    [J]. 2020 16TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM), 2020,
  • [33] Measuring and Predicting Quality of Experience of DASH-based Video Streaming Over LTE
    Jia, Kaikai
    Guo, Yuchun
    Chen, Yishuai
    Zhao, Yongxiang
    [J]. 2016 19TH INTERNATIONAL SYMPOSIUM ON WIRELESS PERSONAL MULTIMEDIA COMMUNICATIONS (WPMC), 2016,
  • [34] Coalition Game-based Approach for Improving the QoE of DASH-based Streaming in Multi-servers Scheme
    El Marai, Oussama
    Bagaa, Miloud
    Taleb, Tarik
    [J]. 2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [35] Deep Reinforcement Learning Based Collaborative Mobile Edge Caching for Omnidirectional Video Streaming
    Tan, Zengjie
    Xu, Yuanyuan
    [J]. WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT I, 2021, 12937 : 453 - 464
  • [36] Online Learning for QoE-based Video Streaming to Mobile Receivers
    Changuel, Nesrine
    Sayadi, Bessem
    Kieffer, Michel
    [J]. 2012 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2012, : 1319 - 1324
  • [37] Muno: Improved Bandwidth Estimation Scheme in Video Conferencing Using Deep Reinforcement Learning
    Nguyen, Van Tu
    Ryu, Sang-Woo
    Ko, Kyung-Chan
    Yoo, Jae-Hyoung
    Hong, James Won-Ki
    [J]. International Journal of Network Management, 2025, 35 (01)
  • [38] On Machine Learning Based Video QoE Estimation Across Different Networks
    Orsolic, Irena
    Seufert, Michael
    [J]. PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS (CONTEL 2021), 2021, : 62 - 69
  • [39] Moving QoE for monitoring DASH video streaming: models and a study of multiple mobile clients
    Kiani Mehr, Sheyda
    Jogalekar, Prasad
    Medhi, Deep
    [J]. JOURNAL OF INTERNET SERVICES AND APPLICATIONS, 2021, 12 (01)
  • [40] Deep reinforcement learning based QoE-aware actor-learner architectures for video streaming in IoT environments
    Naresh, Mandan
    Das, Vikramjeet
    Saxena, Paresh
    Gupta, Manik
    [J]. COMPUTING, 2022, 104 (07) : 1527 - 1550