Viewport Prediction, Bitrate Selection, and Beamforming Design for THz-Enabled 360° Video Streaming

被引:0
|
作者
Setayesh, Mehdi [1 ]
Wong, Vincent W. S. [1 ]
机构
[1] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Streaming media; Prediction algorithms; Bit rate; Array signal processing; Wireless communication; Quality of experience; Predictive models; Terahertz communications; Accuracy; Solid modeling; Deep reinforcement learning (DRL); macro-action decentralized partially observable Markov decision process (MacDec-POMDP); personalized federated learning (PFL); quality of experience (QoE); terahertz (THz) communication; 360 degrees video; viewport prediction; VR; 360-DEGREES; DELIVERY;
D O I
10.1109/TWC.2024.3513221
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
360 degrees videos require significant bandwidth to provide an immersive viewing experience. Wireless systems using terahertz (THz) frequency band can meet this high data rate demand. However, self-blockage is a challenge in such systems. To ensure reliable transmission, this paper explores THz-enabled 360 degrees video streaming through multiple multi-antenna access points (APs). Guaranteeing users' quality of experience (QoE) requires accurate viewport prediction to determine which video tiles to send, followed by asynchronous bitrate selection for those tiles and beamforming design at the APs. To address users' privacy and data heterogeneity, we propose a content-based viewport prediction framework, wherein users' head movement prediction models are trained using a personalized federated learning (PFL) algorithm. To address asynchronous decision-making for tile bitrates and dynamic THz link connections, we formulate the optimization of bitrate selection and beamforming as a macro-action decentralized partially observable Markov decision process (MacDec-POMDP) problem. To efficiently tackle this problem for multiple users, we develop two deep reinforcement learning (DRL) algorithms based on multi-agent actor-critic methods and propose a hierarchical learning framework to train the actor and critic networks. Experimental results show that our proposed approach provides a higher QoE when compared with three benchmark algorithms.
引用
收藏
页码:1849 / 1865
页数:17
相关论文
共 50 条
  • [21] Overview of 360-Degree Video and Viewport Prediction
    Li, Zhenhuai
    Zhan, Yinwei
    Computer Engineering and Applications, 2024, 60 (02)
  • [22] Optimized viewport-adaptive 360-degree video streaming
    Chen, Xiaolei
    Wu, Di
    Ahmad, Ishfaq
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2021, 6 (03) : 347 - 359
  • [23] Transitions of Viewport Quality Adaptation Mechanisms in 360 Degree Video Streaming
    Koch, Christian
    Rak, Arne-Tobias
    Zink, Michael
    Steinmetz, Ralf
    Rizk, Amr
    PROCEEDINGS OF THE 29TH ACM WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO (NOSSDAV'19), 2019, : 14 - 19
  • [24] An Evaluation of Viewport Estimation Methods in 360-Degree Video Streaming
    Duc Nguyen
    2022 7TH INTERNATIONAL CONFERENCE ON BUSINESS AND INDUSTRIAL RESEARCH (ICBIR2022), 2022, : 161 - 166
  • [25] LiveAE: Attention-based and Edge-assisted Viewport Prediction for Live 360° Video Streaming
    Pan, Zipeng
    Zhang, Yuan
    Lin, Tao
    Yan, Jinyao
    PROCEEDINGS OF THE 2023 WORKSHOP ON EMERGING MULTIMEDIA SYSTEMS, EMS 2023, 2023, : 28 - 33
  • [26] Implementing Viewport Tile Extractor for Viewport-Adaptive 360-Degree Video Tiled Streaming
    Jeong, Jong-Beom
    Lee, Soonbin
    Kim, Inae
    Ryu, Eun-Seok
    35TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2021), 2021, : 8 - 12
  • [27] Viewport-Driven Rate-Distortion Optimized 360° Video Streaming
    Chakareski, Jacob
    Aksu, Ridvan
    Corbillon, Xavier
    Simon, Gwendal
    Swaminathan, Viswanathan
    2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2018,
  • [28] A Weighted Tile-based Approach for Viewport Adaptive 360° Video Streaming
    Yaqoob, Abid
    Muntean, Gabriel-Miro
    2020 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2020,
  • [29] An Accurate Viewport Estimation Method for 360 Video Streaming using Deep Learning
    Hung N.V.
    Ngan D.T.
    Son P.N.
    Long D.T.
    Dung N.T.
    Huong T.T.
    EAI Endorsed Transactions on Industrial Networks and Intelligent Systems, 2022, 9 (04)
  • [30] Hybrid-360: An adaptive bitrate algorithm for tile-based 360 video streaming
    Yang, Shujie
    Hu, Jialu
    Jiang, Ke
    Xiao, Han
    Wang, Mu
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2022, 33 (04)