Event-driven Stitching for Tile-based Live 360 Video Streaming

被引:0
|
作者
Chen, Bo [1 ]
Yan, Zhisheng [2 ]
Jin, Haiming [3 ]
Nahrstedt, Klara [1 ]
机构
[1] Univ Illinois, Urbana, IL 61820 USA
[2] Georgia State Univ, Atlanta, GA 30303 USA
[3] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
关键词
Live streaming; tile-based stitching; 360; video;
D O I
10.1145/3304109.3306234
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
360 video streaming is gaining popularity because of the new type of experience it creates. Tile-based approaches have been widely used in VoD 360 video streaming to save the network bandwidth. However, they cannot be extended to the case of live streaming because they assume the 360 videos stitched offline before streaming. Instead, stitching has to be done in real-time in live 360 video streaming. More importantly, the stitching speed as shown in our experiments is one order of magnitude lower than the network transmission speed, making stitching more of a deciding factor of the overall frame rate than the network transmission speed. In this paper, we design a stitching algorithm for tile-based live 360 video streaming that adapts stitching quality to make the best use of the timing budget. There are two main challenges. First, existing tile-based approaches do not consider various semantic information in different scenarios. Second, the decision of tiling schemes for tile-based stitching is non-trivial. To solve the above two challenges, we present an event-driven stitching algorithm for tile-based 360 video live streaming, which consists of such an event-driven model to abstract various semantic information as events and a tile actuator to make tiling scheme decisions. We implement a streaming system based on event-driven stitching called LiveTexture. To evaluate the proposed algorithm, we compare LiveTexture with other baseline systems and show that LiveTexture adapts well to various timing budgets by meeting 89.4% of the timing constraints. We also demonstrate that LiveTexture utilizes the timing budget more efficiently than others.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 50 条
  • [31] Tile-Based Viewport-Adaptive Panoramic Video Streaming on Smartphones
    Qian, Feng
    Han, Bo
    Xiao, Qingyang
    Gopalakrishnan, Vijay
    MOBICOM'18: PROCEEDINGS OF THE 24TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, 2018, : 817 - 819
  • [32] QOE-DRIVEN AND TILE-BASED ADAPTIVE STREAMING FOR POINT CLOUDS
    Wang, Lisha
    Li, Chenglin
    Dai, Wenrui
    Zou, Junni
    Xiong, Hongkai
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1930 - 1934
  • [33] A new tile boundary artifact removal method for tile-based viewport-adaptive streaming in 360° videos
    Ahrar, Amir Mahmoud
    Roodaki, Hoda
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (19) : 29785 - 29803
  • [34] A new tile boundary artifact removal method for tile-based viewport-adaptive streaming in 360∘ videos
    Amir Mahmoud Ahrar
    Hoda Roodaki
    Multimedia Tools and Applications, 2021, 80 : 29785 - 29803
  • [35] Tile-based Caching Optimization for 360° Videos
    Papaioannou, Georgios
    Koutsopoulos, Iordanis
    PROCEEDINGS OF THE 2019 THE TWENTIETH ACM INTERNATIONAL SYMPOSIUM ON MOBILE AD HOC NETWORKING AND COMPUTING (MOBIHOC '19), 2019, : 171 - 180
  • [36] A Multipath Routing Approach for Tile-based Virtual Reality Video Streaming Based on SDN
    Zou, Fanyuan
    Wang, Yumei
    Liu, Yu
    2021 IEEE 45TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2021), 2021, : 560 - 565
  • [37] Bitstream-Quality-Estimation Model for Tile-Based VR Video Streaming Services
    Koike, Masanori
    Urata, Yuichiro
    Yamagishi, Kazuhisa
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2022, E105B (08) : 1002 - 1013
  • [38] Explora-VR: Content Prefetching for Tile-Based Immersive Video Streaming Applications
    Ordonez-Ante, Leandro
    van der Hooft, Jeroen
    Wauters, Tim
    Van Seghbroeck, Gregory
    Volckaert, Bruno
    De Turck, Filip
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2022, 30 (03)
  • [39] Advancing User Quality of Experience Using Viewport Archives in Viewport-Aware Tile-Based 360-Degree Video Streaming
    Dziubinski, Kiana
    Bandai, Masaki
    2021 IEEE INTERNATIONAL WORKSHOP TECHNICAL COMMITTEE ON COMMUNICATIONS QUALITY AND RELIABILITY (CQR 2021), 2021,
  • [40] Metadata-Based Quality-Estimation Model for Tile-Based Omnidirectional Video Streaming
    Urata, Yuichiro
    Koike, Masanori
    Yamagishi, Kazuhisa
    Egi, Noritsugu
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2023, E106B (05) : 478 - 488