Mobile Tile-Based 360° Video Multicast With Cybersickness Alleviation

被引:0
|
作者
Lin, Chiao-Wen [1 ]
Yang, De-Nian [2 ]
Liao, Wanjiun [1 ]
机构
[1] Natl Taiwan Univ, Dept Elect Engn, Taipei City, Taiwan
[2] Acad Sinica, Inst Informat Sci, Res Ctr Informat Technol Innovat, Taipei City, Taiwan
关键词
Cybersickness; Streaming media; Video recording; Quality assessment; Bandwidth; Multicast algorithms; Optical flow; Mobile computing; Costs; User experience; VR; 360(degrees) video; tile-based streaming; cybersickness; multicast; 360 VR VIDEO; OPTIMIZATION; ALLOCATION;
D O I
10.1109/TMC.2024.3514852
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Virtual reality (VR) imaging is 360 degrees, which requires a large bandwidth for video transmission. To address this challenge, tile-based streaming has been proposed to deliver only the focused part of the video instead of the entire one. However, the impact of cybersickness, akin to motion sickness, on tile selection in VR has not been explored. In this paper, we investigate Multi-user Tile Streaming with Cybersickness Control (MTSCC) in an adaptive 360(degrees) video streaming system with multicast and cybersickness alleviation. We propose a novel m(2)-competitive online algorithm that utilizes Individual Sickness Indicator (ISI) and Bitrate Restriction Indicator (BRI) to evaluate user cybersickness tendency and network bandwidth efficiency. Moreover, we introduce the Video Loss Indicator (VLI) and Quality Variance Indicator (QVI) to assess video quality loss and quality difference between tiles. We also propose a multi-armed bandit (MAB) algorithm with confidence bound-based reward (video quality) and cost (cybersickness) estimation. The algorithm learns the weighting factor of each user's cost to slow down cybersickness accumulation for users with high cybersickness tendencies. We prove that the algorithm converges to an optimal solution over time. According to simulation with real network settings, our proposed algorithms outperform baselines in terms of video quality and cybersickness accumulation.
引用
收藏
页码:3423 / 3440
页数:18
相关论文
共 50 条
  • [21] Cooperative Tile-Based 360° Panoramic Streaming in Heterogeneous Networks Using Scalable Video Coding
    Zhang, Xiaoyi
    Hu, Xinjue
    Zhong, Ling
    Shirmohammadi, Shervin
    Zhang, Lin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (01) : 217 - 231
  • [22] An Optimal Tile-Based Approach for Viewport-Adaptive 360-Degree Video Streaming
    Nguyen, Duc, V
    Tran, Huyen T. T.
    Pham, Anh T.
    Truong Cong Thang
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (01) : 29 - 42
  • [23] Tile-Based Panoramic Video Quality Assessment
    Jiang, Zhiqian
    Xu, Yiling
    Sun, Jun
    Hwang, Jenq-Neng
    Zhang, Yunfei
    Appleby, Stephen Clifford
    IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (02) : 530 - 544
  • [24] TVM: A Tile-based Video Management Framework
    Zhong, Tianxiong
    Zhang, Zhiwei
    Lu, Guo
    Yuan, Ye
    Wang, Yu-Ping
    Wang, Guoren
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 17 (04): : 671 - 684
  • [25] Delay Impact on MPEG OMAF's Tile-Based Viewport-Dependent 360° Video Streaming
    de la Fuente, Yago Sanchez
    Bhullar, Gurdeep Singh
    Skupin, Robert
    Hellge, Cornelius
    Schierl, Thomas
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (01) : 18 - 28
  • [26] Tile-based Rate Assignment for 360-Degree Video based on Spatio-Temporal Activity Metrics
    Skupin, Robert
    Sanchez, Yago
    Jiao, Lei
    Hellge, Cornelius
    Schierl, Thomas
    2018 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2018), 2018, : 65 - 68
  • [27] Customized Transmission Protocol for Tile-Based 360° VR Video Streaming Over Core Network Slices
    Wei, Yannan
    Ye, Qiang
    Qu, Kaige
    Zhuang, Weihua
    Shen, Xuemin
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024,
  • [28] A Tile-Based Solution Using Cubemap for Viewport-Adaptive 360-degree Video Delivery
    Tran, Huyen T. T.
    Nguyen, Duc V.
    Nam Pham Ngoc
    Truong Cong Thang
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2019, E102B (07) : 1292 - 1300
  • [29] Tile-Based Wireless Streaming of 360-Degree Video With Rate Adaptation Using Viewport Estimation
    Im, Yeohee
    Qiu, Tian
    Milstein, Laurence B. B.
    Cosman, Pamela C. C.
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2707 - 2711
  • [30] An Optimal Spatial-temporal Smoothness Approach for Tile-based 360-degree Video Streaming
    Ban, Yixuan
    Xie, Lan
    Xu, Zhimin
    Zhang, Xinggong
    Guo, Zongming
    Hu, Yueyu
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,