Viewport Prediction, Bitrate Selection, and Beamforming Design for THz-Enabled 360° Video Streaming

被引:0
|
作者
Setayesh, Mehdi [1 ]
Wong, Vincent W. S. [1 ]
机构
[1] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Streaming media; Prediction algorithms; Bit rate; Array signal processing; Wireless communication; Quality of experience; Predictive models; Terahertz communications; Accuracy; Solid modeling; Deep reinforcement learning (DRL); macro-action decentralized partially observable Markov decision process (MacDec-POMDP); personalized federated learning (PFL); quality of experience (QoE); terahertz (THz) communication; 360 degrees video; viewport prediction; VR; 360-DEGREES; DELIVERY;
D O I
10.1109/TWC.2024.3513221
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
360 degrees videos require significant bandwidth to provide an immersive viewing experience. Wireless systems using terahertz (THz) frequency band can meet this high data rate demand. However, self-blockage is a challenge in such systems. To ensure reliable transmission, this paper explores THz-enabled 360 degrees video streaming through multiple multi-antenna access points (APs). Guaranteeing users' quality of experience (QoE) requires accurate viewport prediction to determine which video tiles to send, followed by asynchronous bitrate selection for those tiles and beamforming design at the APs. To address users' privacy and data heterogeneity, we propose a content-based viewport prediction framework, wherein users' head movement prediction models are trained using a personalized federated learning (PFL) algorithm. To address asynchronous decision-making for tile bitrates and dynamic THz link connections, we formulate the optimization of bitrate selection and beamforming as a macro-action decentralized partially observable Markov decision process (MacDec-POMDP) problem. To efficiently tackle this problem for multiple users, we develop two deep reinforcement learning (DRL) algorithms based on multi-agent actor-critic methods and propose a hierarchical learning framework to train the actor and critic networks. Experimental results show that our proposed approach provides a higher QoE when compared with three benchmark algorithms.
引用
收藏
页码:1849 / 1865
页数:17
相关论文
共 50 条
  • [31] TBRA: Tiling and Bitrate Adaptation for Mobile 360-Degree Video Streaming
    Zhang, Lei
    Suo, Yanyan
    Wu, Ximing
    Wang, Feng
    Chen, Yuchi
    Cui, Laizhong
    Liu, Jiangchuan
    Ming, Zhong
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4007 - 4015
  • [32] IRate: Initial Video Bitrate Selection System for HTTP Streaming
    Mok, Ricky K. P.
    Li, Weichao
    Chang, Rocky K. C.
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2016, 34 (06) : 1914 - 1928
  • [33] Soft Actor-Critic Algorithm for 360-Degree Video Streaming with Long-Term Viewport Prediction
    Gao, Xiaosong
    Zeng, Jiaxin
    Zhou, Xiaobo
    Qiu, Tie
    Li, Keqiu
    2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021), 2021, : 462 - 469
  • [34] VIEWPORT-AWARE ADAPTIVE 360° VIDEO STREAMING USING TILES FOR VIRTUAL REALITY
    Ozcinar, Cagri
    De Abreu, Ana
    Smolic, Aljosa
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2174 - 2178
  • [35] Live360: Viewport-Aware Transmission Optimization in Live 360-Degree Video Streaming
    Chen, Jinyu
    Luo, Zhenxiao
    Wang, Zelong
    Hu, Miao
    Wu, Di
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (01) : 85 - 96
  • [36] SAD360: Spherical Viewport-Aware Dynamic Tiling for 360-Degree Video Streaming
    Li, Zhijun
    Wang, Yumei
    Liu, Yu
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [37] A New Adaptation Approach for Viewport-adaptive 360-degree Video Streaming
    Nguyen, Duc V.
    Tran, Huyen T. T.
    Pham, Anh T.
    Truong Cong Thang
    2017 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2017, : 38 - 44
  • [38] Contextual Bandit Learning-Based Viewport Prediction for 360 Video
    Heyse, Joris
    Vega, Maria Torres
    De Backere, Femke
    De Turck, Filip
    2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 972 - 973
  • [39] A Video Bitrate Adaptation and Prediction Mechanism for HTTP Adaptive Streaming
    Sobhani, Ashkan
    Yassine, Abdulsalam
    Shirmohammadi, Shervin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2017, 13 (02)
  • [40] Quitting Ratio-Based Bitrate Ladder Selection Mechanism for Adaptive Bitrate Video Streaming
    Lebreton, Pierre
    Yamagishi, Kazuhisa
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8418 - 8431