Event-driven Stitching for Tile-based Live 360 Video Streaming

被引:0
|
作者
Chen, Bo [1 ]
Yan, Zhisheng [2 ]
Jin, Haiming [3 ]
Nahrstedt, Klara [1 ]
机构
[1] Univ Illinois, Urbana, IL 61820 USA
[2] Georgia State Univ, Atlanta, GA 30303 USA
[3] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
关键词
Live streaming; tile-based stitching; 360; video;
D O I
10.1145/3304109.3306234
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
360 video streaming is gaining popularity because of the new type of experience it creates. Tile-based approaches have been widely used in VoD 360 video streaming to save the network bandwidth. However, they cannot be extended to the case of live streaming because they assume the 360 videos stitched offline before streaming. Instead, stitching has to be done in real-time in live 360 video streaming. More importantly, the stitching speed as shown in our experiments is one order of magnitude lower than the network transmission speed, making stitching more of a deciding factor of the overall frame rate than the network transmission speed. In this paper, we design a stitching algorithm for tile-based live 360 video streaming that adapts stitching quality to make the best use of the timing budget. There are two main challenges. First, existing tile-based approaches do not consider various semantic information in different scenarios. Second, the decision of tiling schemes for tile-based stitching is non-trivial. To solve the above two challenges, we present an event-driven stitching algorithm for tile-based 360 video live streaming, which consists of such an event-driven model to abstract various semantic information as events and a tile actuator to make tiling scheme decisions. We implement a streaming system based on event-driven stitching called LiveTexture. To evaluate the proposed algorithm, we compare LiveTexture with other baseline systems and show that LiveTexture adapts well to various timing budgets by meeting 89.4% of the timing constraints. We also demonstrate that LiveTexture utilizes the timing budget more efficiently than others.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [21] Delay Impact on MPEG OMAF's Tile-Based Viewport-Dependent 360° Video Streaming
    de la Fuente, Yago Sanchez
    Bhullar, Gurdeep Singh
    Skupin, Robert
    Hellge, Cornelius
    Schierl, Thomas
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (01) : 18 - 28
  • [22] Mobile Tile-Based 360° Video Multicast With Cybersickness Alleviation
    Lin, Chiao-Wen
    Yang, De-Nian
    Liao, Wanjiun
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (04) : 3423 - 3440
  • [23] Customized Transmission Protocol for Tile-Based 360° VR Video Streaming Over Core Network Slices
    Wei, Yannan
    Ye, Qiang
    Qu, Kaige
    Zhuang, Weihua
    Shen, Xuemin
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024,
  • [24] Tile-Based Wireless Streaming of 360-Degree Video With Rate Adaptation Using Viewport Estimation
    Im, Yeohee
    Qiu, Tian
    Milstein, Laurence B. B.
    Cosman, Pamela C. C.
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2707 - 2711
  • [25] Tile-based 360-degree video streaming for mobile virtual reality in cyber physical system
    Son, Jangwoo
    Ryu, Eun-Seok
    COMPUTERS & ELECTRICAL ENGINEERING, 2018, 72 : 361 - 368
  • [26] An Optimal Spatial-temporal Smoothness Approach for Tile-based 360-degree Video Streaming
    Ban, Yixuan
    Xie, Lan
    Xu, Zhimin
    Zhang, Xinggong
    Guo, Zongming
    Hu, Yueyu
    2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [27] MPEG-DASH MPD for Tile-based Hybrid Stereoscopic 360-degree Video Streaming
    You, Dongho
    Jeong, Eunyoung
    Kim, Dong Ho
    2018 TENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN 2018), 2018, : 676 - 678
  • [28] Optimizing Adaptive Tile-Based Virtual Reality Video Streaming
    van der Hooft, Jeroen
    Vega, Maria Torres
    Petrangeli, Stefano
    Wauters, Tim
    De Turck, Filip
    2019 IFIP/IEEE SYMPOSIUM ON INTEGRATED NETWORK AND SERVICE MANAGEMENT (IM), 2019, : 381 - 387
  • [29] TVSR-OR: Tile-based 360-degree video streaming over real time streaming protocol with optimized read
    Zeng, Qimiao
    Yin, Zhifan
    Pan, Qing
    Ma, Yunxiao
    Yu, Yuan
    Zhuang, Yirong
    Liang, Jie
    Yang, Shujie
    Xiao, Han
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2023, 34 (05)
  • [30] SHVC Tile-Based 360-Degree Video Streaming for Mobile VR: PC Offloading Over mmWave
    Dien Van Nguyen
    Tuan Thanh Le
    Lee, Sangsoon
    Ryu, Eun-Seok
    SENSORS, 2018, 18 (11)