Flocking-based Live Streaming of 360-degree Video

被引:39
|
作者
Sun, Liyang [1 ]
Mao, Yixiang [1 ]
Zong, Tongyu [1 ]
Liu, Yong [1 ]
Wang, Yao [1 ]
机构
[1] NYU, New York, NY 10003 USA
关键词
Live 360-degree Video; Collaborative FoV Prediction; Edge Caching;
D O I
10.1145/3339825.3391856
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Streaming of live 360-degree video allows users to follow a live event from any view point and has already been deployed on some commercial platforms. However, the current systems can only stream the video at relatively low-quality because the entire 360-degree video is delivered to the users under limited bandwidth. In this paper, we propose to use the idea of "flocking" to improve the performance of both prediction of field of view (FoV) and caching on the edge servers for live 360-degree video streaming. By assigning variable playback latencies to all the users in a streaming session, a "streaming flock" is formed and led by low latency users in the front of the flock. We propose a collaborative FoV prediction scheme where the actual FoV information of users in the front of the flock are utilized to predict of users behind them. We further propose a network condition aware flocking strategy to reduce the video freeze and increase the chance for collaborative FoV prediction on all users. Flocking also facilitates caching as video tiles downloaded by the front users can be cached by an edge server to serve the users at the back of the flock, thereby reducing the traffic in the core network. We propose a latency-FoV based caching strategy and investigate the potential gain of applying transcoding on the edge server. We conduct experiments using real-world user FoV traces and WiGig network bandwidth traces to evaluate the gains of the proposed strategies over benchmarks. Our experimental results demonstrate that the proposed streaming system can roughly double the effective video rate, which is the video rate inside a user's actual FoV, compared to the prediction only based on the user's own past FoV trajectory, while reducing video freeze. Furthermore, edge caching can reduce the traffic in the core network by about 80%, which can be increased to 90% with transcoding on edge server.
引用
收藏
页码:26 / 37
页数:12
相关论文
共 50 条
  • [1] Live360: Viewport-Aware Transmission Optimization in Live 360-Degree Video Streaming
    Chen, Jinyu
    Luo, Zhenxiao
    Wang, Zelong
    Hu, Miao
    Wu, Di
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (01) : 85 - 96
  • [2] Mobile Streaming of Live 360-Degree Videos
    Eltobgy, Omar
    Arafa, Omar
    Hefeeda, Mohamed
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (12) : 3139 - 3152
  • [3] RATS: Adaptive 360-degree Live Streaming
    Ballard, Trevor
    Griwodz, Carsten
    Steinmetz, Ralf
    Rizk, Amr
    PROCEEDINGS OF THE 10TH ACM MULTIMEDIA SYSTEMS CONFERENCE (ACM MMSYS'19), 2019, : 308 - 311
  • [4] Scalable Multicast for Live 360-Degree Video Streaming Over Mobile Networks
    Nguyen, Duc
    Hung, Nguyen Viet
    Phong, Nguyen Tien
    Huong, Truong Thu
    Thang, Truong Cong
    IEEE Access, 2022, 10 : 38802 - 38812
  • [5] Scalable Multicast for Live 360-Degree Video Streaming Over Mobile Networks
    Duc Nguyen
    Nguyen Viet Hung
    Nguyen Tien Phong
    Truong Thu Huong
    Truong Cong Thang
    IEEE ACCESS, 2022, 10 : 38802 - 38812
  • [6] CA-Live360: Crowd-assisted transcoding and delivery for live 360-degree video streaming
    Ma, Yunxiao
    Xu, Changqiao
    Wu, Zhonghui
    Ding, Renjie
    Xiao, Han
    Zhong, Lujie
    Zhuang, Yirong
    Muntean, Gabriel-Miro
    COMPUTER NETWORKS, 2024, 251
  • [7] 360-Degree Video Streaming Using Stitching Information
    Seo, Bong-Seok
    Jeong, Eunyoung
    Hyun, ChangJong
    You, Dongho
    Kim, Dong Ho
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [8] Optimal Tile-Based Encoding for 360-Degree Video Streaming
    Gao, Wenxuan
    Li, Chenglin
    Lv, Haoran
    Dai, Wenrui
    Zou, Junni
    Xiong, Hongkai
    Pan, Xinlong
    Wang, Haipeng
    2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 295 - 299
  • [9] A client-based adaptation framework for 360-degree video streaming
    Nguyen, D. V.
    Tran, Huyen T. T.
    Truong Cong Thang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 59 : 231 - 243
  • [10] A novel transmission approach based on video content for 360-degree streaming
    Hong Zhang
    Fan Li
    Zhisheng Yan
    Multimedia Tools and Applications, 2022, 81 : 34067 - 34085