Event-driven Stitching for Tile-based Live 360 Video Streaming

被引:0
|
作者
Chen, Bo [1 ]
Yan, Zhisheng [2 ]
Jin, Haiming [3 ]
Nahrstedt, Klara [1 ]
机构
[1] Univ Illinois, Urbana, IL 61820 USA
[2] Georgia State Univ, Atlanta, GA 30303 USA
[3] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
关键词
Live streaming; tile-based stitching; 360; video;
D O I
10.1145/3304109.3306234
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
360 video streaming is gaining popularity because of the new type of experience it creates. Tile-based approaches have been widely used in VoD 360 video streaming to save the network bandwidth. However, they cannot be extended to the case of live streaming because they assume the 360 videos stitched offline before streaming. Instead, stitching has to be done in real-time in live 360 video streaming. More importantly, the stitching speed as shown in our experiments is one order of magnitude lower than the network transmission speed, making stitching more of a deciding factor of the overall frame rate than the network transmission speed. In this paper, we design a stitching algorithm for tile-based live 360 video streaming that adapts stitching quality to make the best use of the timing budget. There are two main challenges. First, existing tile-based approaches do not consider various semantic information in different scenarios. Second, the decision of tiling schemes for tile-based stitching is non-trivial. To solve the above two challenges, we present an event-driven stitching algorithm for tile-based 360 video live streaming, which consists of such an event-driven model to abstract various semantic information as events and a tile actuator to make tiling scheme decisions. We implement a streaming system based on event-driven stitching called LiveTexture. To evaluate the proposed algorithm, we compare LiveTexture with other baseline systems and show that LiveTexture adapts well to various timing budgets by meeting 89.4% of the timing constraints. We also demonstrate that LiveTexture utilizes the timing budget more efficiently than others.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [41] Explora-VR: Content Prefetching for Tile-Based Immersive Video Streaming Applications
    Leandro Ordonez-Ante
    Jeroen van der Hooft
    Tim Wauters
    Gregory Van Seghbroeck
    Bruno Volckaert
    Filip De Turck
    Journal of Network and Systems Management, 2022, 30
  • [42] Performance Evaluations of Tile-based 360-degree DASH Streaming with Clustering-based Viewport Prediction
    Shinohara, Yuya
    Shirasaki, Satomi
    Wu, Yiyan
    Kanai, Kenji
    Katto, Jiro
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [43] 360-Degree Video Streaming Using Stitching Information
    Seo, Bong-Seok
    Jeong, Eunyoung
    Hyun, ChangJong
    You, Dongho
    Kim, Dong Ho
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2019,
  • [44] Rate-mixed HEVC Tile based 360 Video Streaming System
    Luo, Ying
    Liu, Xu
    Zhu, Chen
    Xie, Rong
    Song, Li
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [45] Comparison of HEVC Coding Schemes For Tile-based Viewport-adaptive Streaming of Omnidirectional Video
    Ghaznavi-Youvalari, Ramin
    Zare, Alireza
    Fang, Huameng
    Aminlou, Alireza
    Xie, Qingpeng
    Hannuksela, Miska M.
    Gabbouj, Moncef
    2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2017,
  • [46] Tile-Based Panoramic Video Quality Assessment
    Jiang, Zhiqian
    Xu, Yiling
    Sun, Jun
    Hwang, Jenq-Neng
    Zhang, Yunfei
    Appleby, Stephen Clifford
    IEEE TRANSACTIONS ON BROADCASTING, 2022, 68 (02) : 530 - 544
  • [47] Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
    Dziubinski, Kiana
    Bandai, Masaki
    IEEE ACCESS, 2022, 10 : 94652 - 94667
  • [48] Shared Coded Picture Technique for Tile-Based Viewport-Adaptive Streaming of Omnidirectional Video
    Ghaznavi-Youvalari, Ramin
    Zare, Alireza
    Aminlou, Alireza
    Hannuksela, Miska M.
    Gabbouj, Moncef
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 3106 - 3120
  • [49] Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
    Dziubinski, Kiana
    Bandai, Masaki
    IEEE Access, 2022, 10 : 94652 - 94667
  • [50] TVM: A Tile-based Video Management Framework
    Zhong, Tianxiong
    Zhang, Zhiwei
    Lu, Guo
    Yuan, Ye
    Wang, Yu-Ping
    Wang, Guoren
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 17 (04): : 671 - 684