Viewport Prediction, Bitrate Selection, and Beamforming Design for THz-Enabled 360° Video Streaming

被引:0
|
作者
Setayesh, Mehdi [1 ]
Wong, Vincent W. S. [1 ]
机构
[1] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Streaming media; Prediction algorithms; Bit rate; Array signal processing; Wireless communication; Quality of experience; Predictive models; Terahertz communications; Accuracy; Solid modeling; Deep reinforcement learning (DRL); macro-action decentralized partially observable Markov decision process (MacDec-POMDP); personalized federated learning (PFL); quality of experience (QoE); terahertz (THz) communication; 360 degrees video; viewport prediction; VR; 360-DEGREES; DELIVERY;
D O I
10.1109/TWC.2024.3513221
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
360 degrees videos require significant bandwidth to provide an immersive viewing experience. Wireless systems using terahertz (THz) frequency band can meet this high data rate demand. However, self-blockage is a challenge in such systems. To ensure reliable transmission, this paper explores THz-enabled 360 degrees video streaming through multiple multi-antenna access points (APs). Guaranteeing users' quality of experience (QoE) requires accurate viewport prediction to determine which video tiles to send, followed by asynchronous bitrate selection for those tiles and beamforming design at the APs. To address users' privacy and data heterogeneity, we propose a content-based viewport prediction framework, wherein users' head movement prediction models are trained using a personalized federated learning (PFL) algorithm. To address asynchronous decision-making for tile bitrates and dynamic THz link connections, we formulate the optimization of bitrate selection and beamforming as a macro-action decentralized partially observable Markov decision process (MacDec-POMDP) problem. To efficiently tackle this problem for multiple users, we develop two deep reinforcement learning (DRL) algorithms based on multi-agent actor-critic methods and propose a hierarchical learning framework to train the actor and critic networks. Experimental results show that our proposed approach provides a higher QoE when compared with three benchmark algorithms.
引用
收藏
页码:1849 / 1865
页数:17
相关论文
共 50 条
  • [1] Smooth Viewport Bitrate Adaptation for 360 Video Streaming
    Hoang Le Dieu Huong
    Nguyen, Duc, V
    Truong Thu Huong
    Pham Ngoc Nam
    Truong Cong Thang
    PROCEEDINGS OF 2019 6TH NATIONAL FOUNDATION FOR SCIENCE AND TECHNOLOGY DEVELOPMENT (NAFOSTED) CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS), 2019, : 512 - 517
  • [2] Online Bitrate Selection for Viewport Adaptive 360-Degree Video Streaming
    Tang, Ming
    Wong, Vincent W. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (07) : 2506 - 2517
  • [3] SVP: Sinusoidal Viewport Prediction for 360-Degree Video Streaming
    Jiang, Xiaolan
    Naas, Si Ahmed
    Chiang, Yi-Han
    Sigg, Stephan
    Ji, Yusheng
    IEEE ACCESS, 2020, 8 : 164471 - 164481
  • [4] Efficient viewport prediction and tiling schemes for 360 degree video streaming
    Adhuran, Jayasingam
    Martini, Maria G.
    PROCEEDINGS OF THE 2024 15TH ACM MULTIMEDIA SYSTEMS CONFERENCE 2024, MMSYS 2024, 2024, : 374 - 380
  • [5] Adaptive Tiling Selection for Viewport Adaptive Streaming of 360-degree Video
    Nguyen, Duc V.
    Tran, Huyen T. T.
    Thang, Truong Cong
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (01) : 48 - 51
  • [6] SMART360: Simulating Motion prediction and Adaptive bitRate sTrategies for 360° video streaming
    Guimard, Quentin
    Sassatelli, Lucile
    PROCEEDINGS OF THE 2023 PROCEEDINGS OF THE 14TH ACM MULTIMEDIA SYSTEMS CONFERENCE, MMSYS 2023, 2023, : 384 - 390
  • [7] Sparkle: User-Aware Viewport Prediction in 360-Degree Video Streaming
    Chen, Jinyu
    Luo, Xianzhuo
    Hu, Miao
    Wu, Di
    Zhou, Yipeng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3853 - 3866
  • [8] Compass: A Prefetching Framework with Viewport Patching for 360° Video Streaming
    Su, Wenjing
    Li, Yueheng
    Chen, Hao
    Ma, Zhan
    PROCEEDINGS OF THE 2024 SIGCOMM WORKSHOP ON EMERGING MULTIMEDIA SYSTEMS, EMS 2024, 2024, : 45 - 51
  • [9] CUB360: EXPLOITING CROSS-USERS BEHAVIORS FOR VIEWPORT PREDICTION IN 360 VIDEO ADAPTIVE STREAMING
    Ban, Yixuan
    Xie, Lan
    Xu, Zhimin
    Zhang, Xinggong
    Guo, Zongming
    Wang, Yue
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2018,
  • [10] An Evaluation of Tile Selection Methods for Viewport-Adaptive Streaming of 360-Degree Video
    Nguyen, Duc, V
    Tran, Huyen T. T.
    Truong Cong Thang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)