End-to-End Multi-User 360-Degree Video Delivery Using Users' Fixation Points

被引:0
|
作者
Okamoto, Tsubasa [1 ]
Ishioka, Takumasa [1 ,2 ]
Fukui, Tatsuya [3 ]
Tsugami, Ryouhei [3 ]
Fujiwara, Toshihito [3 ]
Narikawa, Satoshi [3 ]
Fujihashi, Takuya [1 ]
Saruwatari, Shunsuke [1 ]
Watanabe, Takashi [1 ]
机构
[1] Osaka Univ, Kyoto Tachibana Univ, Fac Engn,Dept Informat & Comp Sci, Grad Sch Informat Sci & Technol, Osaka 5650871, Japan
[2] Kyoto Tachibana Univ, Fac Engn, Dept Informat & Comp Sci, Kyoto 6078175, Japan
[3] NTT Corp, Access Network Serv Syst Labs, Tokyo 1808585, Japan
关键词
Virtual reality (VR); dual fisheye; hybrid multicast and unicast;
D O I
10.1109/ACCESS.2024.3353812
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Viewport-based 360-degree video delivery is a typical method to reduce video traffic for virtual reality (VR) applications. However, viewport-based solutions cause key issues in multi-user VR applications, including high video traffic due to redundant video transmission across multiple headset users and quality degradation due to viewport transitions. These problems occur in both camera-to-server and server-to-user video transmissions. In this study, we propose a 360-degree video delivery scheme for multi-user VR applications. To overcome the above issues, the proposed approach includes appropriate quality and transmission control for camera-to-server and server-to-user video transmissions. The camera extracts the estimated potential region from the dual fisheye video. The server controls recompression at the server to follow the viewport transition and hybrid unicast and multicast tile delivery to avoid redundant transmissions. Evaluations using 360-degree video and corresponding fixation points from multiple users show that the proposed scheme prevents redundant transmissions across multiple headset users and provides better viewport quality for each user under the same video traffic. For example, the proposed scheme reduces video traffic by up to 36.4% compared to the existing viewport-based 360-degree video delivery scheme for ten headset users.
引用
收藏
页码:9151 / 9161
页数:11
相关论文
共 21 条
  • [1] Edge-Assisted Multi-User 360-Degree Video Delivery
    Okamoto, Tsubasa
    Ishioka, Takumasa
    Shiina, Ryota
    Fukui, Tatsuya
    Ono, Hiroya
    Fujiwara, Toshihito
    Fujihashi, Takuya
    Saruwatari, Shunsuke
    Watanabe, Takashi
    [J]. 2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [2] Ebublio: Edge Assisted Multi-user 360-Degree Video Streaming
    Jin, Yili
    Liu, Junhua
    Wang, Fangxin
    [J]. 2022 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS (VRW 2022), 2022, : 591 - 592
  • [3] SERVER-SIDE RATE ADAPTATION FOR MULTI-USER 360-DEGREE VIDEO STREAMING
    Liu, Chengming
    Kan, Nuowen
    Zou, Junni
    Yang, Qin
    Xiong, Hongkai
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3264 - 3268
  • [4] Benchmarking and Interpreting End-to-End Learning of MIMO and Multi-User Communication
    Song, Jinxiang
    Hager, Christian
    Schroder, Jochen
    O'Shea, Timothy J.
    Agrell, Erik
    Wymeersch, Henk
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 7287 - 7298
  • [5] Using IoT Platform for 360-Degree Video User Logging and Analysis
    Luoto, Antti
    Systa, Kari
    Hylli, Otto
    Heikkila, Ville
    [J]. PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON WEB INFORMATION SYSTEMS AND TECHNOLOGIES (WEBIST), 2020, : 41 - 50
  • [6] Learning End-to-End Hybrid Precoding for Multi-User mmWave Mobile System with GNNs
    Wang, Ruiming
    Yang, Chenyang
    Han, Shengqian
    Wu, Jiajun
    Han, Shuangfeng
    Wang, Xiaoyun
    [J]. IEEE Transactions on Machine Learning in Communications and Networking, 2024, 2 : 978 - 993
  • [7] A SERVER-SIDE OPTIMIZED HYBRID MULTICAST-UNICAST STRATEGY FOR MULTI-USER ADAPTIVE 360-DEGREE VIDEO STREAMING
    Kan, Nuowen
    Liu, Chengming
    Zou, Junni
    Li, Chenglin
    Xiong, Hongkai
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 141 - 145
  • [8] End-To-End Controls Using K-Means Algorithm for 360-Degree Video Control Method on Omnidirectional Camera-Equipped Autonomous Micro Unmanned Aircraft Systems
    Kwak, Jeonghoon
    Sung, Yunsick
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (20):
  • [9] Deep-learning-based multi-user framework for end-to-end fiber-MMW communications
    Li, Zhongya
    Jia, Junlian
    Li, Guoqiang
    Dong, Boyu
    Shen, Wangwei
    Huang, Changle
    Shi, Jianyang
    Chi, Nan
    Zhang, Junwen
    [J]. OPTICS EXPRESS, 2023, 31 (10) : 15239 - 15255
  • [10] Towards Security and Privacy for Multi-User Augmented Reality: Foundations with End Users
    Lebeck, Kiron
    Ruth, Kimberly
    Kohno, Tadayoshi
    Roesner, Franziska
    [J]. 2018 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP), 2018, : 392 - 408