WiFi-VLC Dual Connectivity Streaming System for 6DOF Multi-User Virtual Reality

被引:5
|
作者
Chakareski, Jacob [1 ]
Khan, Mahmudur [2 ]
机构
[1] New Jersey Inst Technol, Newark, NJ 07102 USA
[2] York Coll Penn, York, PA USA
关键词
6DOF Virtual Reality; Visible Light Communication; WiFi-VLC Dual Connectivity Wireless Streaming; Scalable 360 degrees Video Tiling;
D O I
10.1145/3458306.3460999
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We investigate a future WiFi-VLC dual connectivity streaming system for 6DOF multi-user virtual reality that enables reliable highfidelity remote scene immersion. The system integrates an edge server that uses scalable 360 degrees tiling to adaptively split the present 360 degrees view of a VR user into a panoramic baseline content layer and a viewport-specific enhancement content layer. The user is then served the two content layers over complementary WiFi and VLC wireless links such that the delivered viewport quality is maximized for the given WiFi and VLC transmission resources. We formally characterize the actions of the server using rate-distortion optimization that we solve at low complexity. To account for the users' mobility as they explore different 360 degrees viewpoints of the 6DOF remote scene content and maintain reliable high-quality VLC connectivity, we explore dynamic VLC transmitter steering and assignment in the system as graph bottleneck matching that aims to maximize the received VLC SNR across all users. We formulate an effective low-complexity solution to this discrete combinatorial optimization problem of high complexity. The paper also contributes a first actual 6DOF body and head movement VR navigation dataset that we collected and facilitate to assess the performance of our system via simulation experiments. These demonstrate enhanced VLC transmission performance and an up to 7 dB gain in viewport quality over a state-of-the-art VLC cellular system (LiFi), and an up to 10 dB gain in viewport quality over a state-of-the-art traditional wireless streaming method, for 12K-120fps 360 degrees 6DOF VR content. Moreover, the synergistic WiFi-VLC dual connectivity of the proposed system augments its reliability over the reference method LiFi that comprises only VLC links. These outcomes motivate further exploration and prototype implementation of our system.
引用
收藏
页码:107 / 113
页数:7
相关论文
共 11 条
  • [1] Millimeter Wave and Free-space-optics for Future Dual-connectivity 6DOF Mobile Multi-user VR Streaming
    Chakareski, Jacob
    Khan, Mahmudur
    Ropitault, Tanguy
    Blandino, Steve
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [2] Demonstrating Nebula: Dynamic Multi-Scents in 6DoF Virtual Reality
    Elst, Pierre-Philippe
    Javerliat, Charles
    Villenave, Sophie
    Lavoue, Guillaume
    2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 1174 - 1175
  • [3] Towards Viewport-dependent 6DoF 360 Video Tiled Streaming for Virtual Reality Systems
    Jeong, Jong-Beom
    Lee, Soonbin
    Ryu, Il-Woong
    Le, Tuan Thanh
    Ryu, Eun-Seok
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 3687 - 3695
  • [4] Viewport-Adaptive Scalable Multi-User Virtual Reality Mobile-Edge Streaming
    Chakareski, Jacob
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6330 - 6342
  • [5] Markerless Multi-View-based Multi-User Head Tracking System for Virtual Reality Applications
    Bicho, Dylan
    Girao, Pedro
    Paulo, Joao
    Garrote, Luis
    Nunes, Urbano J.
    Peixoto, Paulo
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 2645 - 2652
  • [6] Implementation and Evaluation of Multi-User Mind Map Authoring System using Virtual Reality and Hand Gestures
    Miyasugi, Masayuki
    Akaike, Hideo
    Nakayama, Yasuichi
    Kakuda, Hiroyasu
    2017 IEEE 6TH GLOBAL CONFERENCE ON CONSUMER ELECTRONICS (GCCE), 2017,
  • [7] Two-handed 6DOF manipulation with haptic in immersive virtual environment with multi-projection screen system
    Luo, YL
    Sun, B
    Murayama, J
    Sato, M
    SYSTEM SIMULATION AND SCIENTIFIC COMPUTING, VOLS 1 AND 2, PROCEEDINGS, 2005, : 934 - 939
  • [8] Minimising the latency induced by consistency control within a large scale multi-user distributed virtual reality system
    Roberts, DJ
    Sharkey, PM
    SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 4492 - 4497
  • [9] Using a multi-user desktop-based virtual reality system to recreate the Sao Miguel das Missoes ruins
    dos Santos, SR
    Fraga, LS
    CYBERPSYCHOLOGY & BEHAVIOR, 2002, 5 (05): : 471 - 479
  • [10] 6DOF Virtual Reality Dataset and Performance Evaluation of Millimeter Wave vs. Free-Space-Optical Indoor Communications Systems for Lifelike Mobile VR Streaming
    Chakareski, Jacob
    Khan, Mahmudur
    Ropitault, Tanguy
    Blandino, Steve
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 1051 - 1058