FoVR: Attention-based VR Streaming through Bandwidth-limited Wireless Networks

被引:3
|
作者
Yang, Songzhou [1 ,2 ]
He, Yuan [1 ,2 ]
Zheng, Xiaolong [3 ]
机构
[1] Tsinghua Univ, Sch Software, Beijing, Peoples R China
[2] Tsinghua Univ, BNRist, Beijing, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Virtual Reality; 360 degrees Video; Streaming; Scheduling; Attention Prediction; Region of Interest;
D O I
10.1109/sahcn.2019.8824804
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Consumer Virtual Reality (VR) has been widely used in various application areas, such as entertainment and medicine. In spite of the superb immersion experience, to enable high-quality VR on untethered mobile devices remains an extremely challenging task. The high bandwidth demands of VR streaming generally overburden a conventional wireless connection, which affects the user experience and in turn limits the usability of VR in practice. In this paper, we propose FoVR, attention-based hierarchical VR streaming through bandwidth-limited wireless networks. The design of FoVR stems from the insight that human's vision is hierarchical, so that different areas in the field of view (FoV) can be served with VR content of different qualities. By exploiting the gaze tracking capacity of the VR devices, FoVR is able to accurately predict the user's attention so that the streaming of hierarchical VR can be appropriately scheduled. In this way, FoVR significantly reduces the bandwidth cost and computing cost while keeping high quality of user experience. We implement FoVR on a commercial VR device and evaluate its performance in various scenarios. The experiment results show that FoVR reduces the bandwidth cost by 88.9% and 76.2%, respectively compared to the original VR streaming and the state-of-the-art approach.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Predictive Tile Selection for 360-Degree VR Video Streaming in Bandwidth-Limited Networks
    Thanh Cong Nguyen
    Yun, Ji-Hoon
    [J]. IEEE COMMUNICATIONS LETTERS, 2018, 22 (09) : 1858 - 1861
  • [2] Low-Latency Live Streaming Over HTTP in Bandwidth-Limited Networks
    Ozcelik, Ihsan Mert
    Ersoy, Cem
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (02) : 450 - 454
  • [3] Bandwidth-Limited Cluster Networks for Distributed MIMO
    Liberti, Joseph C.
    Koshy, John C.
    [J]. 2013 ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, 2013, : 717 - 721
  • [4] Resource management in energy-limited, bandwidth-limited, transceiver-limited wireless networks for session-based multicasting
    Wieselthier, JE
    Nguyen, GD
    Ephremides, A
    [J]. COMPUTER NETWORKS, 2002, 39 (02) : 113 - 131
  • [5] A Cognitive Perspective for Information Processing in Bandwidth-Limited Wireless Communications
    Tao, Xiaoming
    Dong, Linhao
    Li, Shaoyang
    Li, Yang
    Ge, Ning
    Lu, Jianhua
    [J]. 2014 IEEE 13TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI-CC), 2014, : 289 - 295
  • [6] Attention-based video streaming
    Dikici, Cagatay
    Bozma, H. Isil
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2010, 25 (10) : 745 - 760
  • [7] Multipath routing for video unicast over bandwidth-limited networks
    Chen, JC
    Chan, SHG
    [J]. GLOBECOM '01: IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-6, 2001, : 1963 - 1967
  • [8] Online Routing and Scheduling in Bandwidth-Limited Delay Tolerant Networks
    Yang, Zhenguo
    Huang, Liusheng
    Xiao, Mingjun
    Zhang, Yindong
    Zhu, Youwen
    [J]. AD HOC & SENSOR WIRELESS NETWORKS, 2013, 18 (3-4) : 311 - 331
  • [9] Algorithms for bandwidth-limited energy-efficient wireless broadcasting and multicasting
    Wieselthier, JE
    Nguyen, GD
    Ephremides, A
    [J]. MILCOM 2000: 21ST CENTURY MILITARY COMMUNICATIONS CONFERENCE PROCEEDINGS, VOLS 1 AND 2: ARCHITECTURES & TECHNOLOGIES FOR INFORMATION SUPERIORITY, 2000, : 485 - 490
  • [10] Multipath routing for video delivery over bandwidth-limited networks
    Chen, JC
    Chan, SHG
    Li, VOK
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2004, 22 (10) : 1920 - 1932