Flocking-based Live Streaming of 360-degree Video

被引:39
|
作者
Sun, Liyang [1 ]
Mao, Yixiang [1 ]
Zong, Tongyu [1 ]
Liu, Yong [1 ]
Wang, Yao [1 ]
机构
[1] NYU, New York, NY 10003 USA
关键词
Live 360-degree Video; Collaborative FoV Prediction; Edge Caching;
D O I
10.1145/3339825.3391856
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Streaming of live 360-degree video allows users to follow a live event from any view point and has already been deployed on some commercial platforms. However, the current systems can only stream the video at relatively low-quality because the entire 360-degree video is delivered to the users under limited bandwidth. In this paper, we propose to use the idea of "flocking" to improve the performance of both prediction of field of view (FoV) and caching on the edge servers for live 360-degree video streaming. By assigning variable playback latencies to all the users in a streaming session, a "streaming flock" is formed and led by low latency users in the front of the flock. We propose a collaborative FoV prediction scheme where the actual FoV information of users in the front of the flock are utilized to predict of users behind them. We further propose a network condition aware flocking strategy to reduce the video freeze and increase the chance for collaborative FoV prediction on all users. Flocking also facilitates caching as video tiles downloaded by the front users can be cached by an edge server to serve the users at the back of the flock, thereby reducing the traffic in the core network. We propose a latency-FoV based caching strategy and investigate the potential gain of applying transcoding on the edge server. We conduct experiments using real-world user FoV traces and WiGig network bandwidth traces to evaluate the gains of the proposed strategies over benchmarks. Our experimental results demonstrate that the proposed streaming system can roughly double the effective video rate, which is the video rate inside a user's actual FoV, compared to the prediction only based on the user's own past FoV trajectory, while reducing video freeze. Furthermore, edge caching can reduce the traffic in the core network by about 80%, which can be increased to 90% with transcoding on edge server.
引用
收藏
页码:26 / 37
页数:12
相关论文
共 50 条
  • [31] DRL360: 360-degree Video Streaming with Deep Reinforcement Learning
    Zhang, Yuanxing
    Zhao, Pengyu
    Bian, Kaigui
    Liu, Yunxin
    Song, Lingyang
    Li, Xiaoming
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2019), 2019, : 1252 - 1260
  • [32] Region Priority Based Adaptive 360-degree Video Streaming Using DASH
    Yang, Fuxing
    Luo, Jiangtao
    Yang, Junchao
    Xu, Zheng
    2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 398 - 405
  • [33] ClusTile: Toward Minimizing Bandwidth in 360-degree Video Streaming
    Zhou, Chao
    Xiao, Mengbai
    Liu, Yao
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2018), 2018, : 962 - 970
  • [34] QoE-Driven Coupled Uplink and Downlink Rate Adaptation for 360-Degree Video Live Streaming
    Li, Jie
    Feng, Ransheng
    Sun, Wei
    Liu, Zhi
    Li, Qiyue
    IEEE COMMUNICATIONS LETTERS, 2020, 24 (04) : 863 - 867
  • [35] 360HRL: Hierarchical Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming
    Fu, Jun
    Hou, Chen
    Chen, Zhibo
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [36] Perception-Based Pseudo-Motion Response for 360-Degree Video Streaming
    Zhang, Jiaqi
    Yu, Lu
    Yu, Hualong
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1973 - 1977
  • [37] SR360: Boosting 360-Degree Video Streaming with Super-Resolution
    Chen, Jiawen
    Hu, Miao
    Luo, Zhenxiao
    Wang, Zelong
    Wu, Di
    NOSSDAV '20: PROCEEDINGS OF THE 2020 WORKSHOP ON NETWORK AND OPERATING SYSTEM SUPPORT FOR DIGITAL AUDIO AND VIDEO, 2020, : 1 - 6
  • [38] JUST360: Optimizing 360-Degree Video Streaming Systems With Joint Utility
    Li, Zhijun
    Wang, Yumei
    Liu, Yu
    Li, Junjie
    Zhu, Ping
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (02) : 468 - 481
  • [39] MAIVS: Machine Learning Based Adaptive UHD 360-degree Immersive Video Streaming
    Singhal, Chetna
    Ghosh, Monalisa
    Mittal, Himanshu
    Dewangan, Pravartya
    2023 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS, 2023, : 1082 - 1087
  • [40] QoE-aware 360-degree Video Streaming for Autonomous Vehicles
    Han, Yi
    Aldaif, Ammar A. Q.
    Yuan, Huijun
    Zhong, Yi
    Zheng, Yi
    Liao, Yangzhe
    Li, Qing
    2023 IEEE 97TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-SPRING, 2023,