Viewport-adaptive 360-Degree Video Coding Using Non-uniform Tiles for Virtual Reality Communication

被引:0
|
作者
Zhou, Yufeng [1 ]
Chen, Ken [1 ]
Yu, Mei [1 ,2 ]
Jiang, Hao [1 ]
Jiang, Gangyi [1 ,2 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo, Peoples R China
[2] Nanjing Univ, Natl Key Lab Software New Technol, Nanjing, Peoples R China
关键词
360 degrees video coding; viewport-adaptive; Equir-ectangular Projection (ERP); non-uniform tile;
D O I
10.1117/12.2538695
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
360 degrees video can provide users with immersive experience by showing the omnidirectional perspective, which is getting more attractive to consumers. However, 360 degrees video tends to have higher resolution, resulting in increased bandwidth requirements for transmission. The characteristic of head-mounted displays (HMD) provides a new approach to reducing the cost of streaming 360 degrees video bandwidth, which can encode 360 degrees video by considering user's orientation. In this paper, we propose a novel 360 degrees video coding method based on the characteristics of Equi-rectangular Projection (ERP) and combined with user-oriented behavior. Specifically, a non-uniform tile method according is designed to the principle of ERP, which also meets the behavioral of users viewing 360 degrees video. Additionally, appropriate coding parameters are set according to the positions of different tiles to reduce the redundancy introduced by oversampling to improve the coding efficiency. Experimental results show the proposed method can reduce the bandwidth requirement of streaming 360 degrees video while ensuring the consistent visual quality, significantly.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Intra prediction using face continuity in 360-degree video coding
    Hanhart, Philippe
    He, Yuwen
    Ye, Yan
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XL, 2017, 10396
  • [42] Adaptive Transmission Strategy for Non-Uniform Coding of 360° Videos
    Guo, Jia
    Li, Shiqiang
    Zhu, Jinqi
    Li, Xiang
    Sun, Bowen
    Feng, Weijia
    ELECTRONICS, 2024, 13 (16)
  • [43] 360-degree virtual reality video to teach neonatal resuscitation: an exploratory development study
    Tachejian, Sevag
    Moussa, Ahmed
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [44] Tile-Based Wireless Streaming of 360-Degree Video With Rate Adaptation Using Viewport Estimation
    Im, Yeohee
    Qiu, Tian
    Milstein, Laurence B. B.
    Cosman, Pamela C. C.
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2707 - 2711
  • [45] Advancing User Quality of Experience Using Viewport Archives in Viewport-Aware Tile-Based 360-Degree Video Streaming
    Dziubinski, Kiana
    Bandai, Masaki
    2021 IEEE INTERNATIONAL WORKSHOP TECHNICAL COMMITTEE ON COMMUNICATIONS QUALITY AND RELIABILITY (CQR 2021), 2021,
  • [46] Performance Study of AV1 Encoders and Presets for 360-degree Video in Virtual Reality
    Kufa, Jan
    Polak, Ladislav
    Kratochvil, Tomas
    2021 31ST INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2021,
  • [47] 360-degree panoramic video generation using virtual and actual multiple cameras
    Ok, Sooyol
    Lee, Suk-Hwan
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2023, 14 (01): : 2 - 17
  • [48] Synergistic Temporal-Spatial User-Aware Viewport Prediction for Optimal Adaptive 360-Degree Video Streaming
    Wang, Yumei
    Li, Junjie
    Li, Zhijun
    Shang, Simou
    Liu, Yu
    IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (02) : 453 - 467
  • [49] Region Priority Based Adaptive 360-degree Video Streaming Using DASH
    Yang, Fuxing
    Luo, Jiangtao
    Yang, Junchao
    Xu, Zheng
    2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 398 - 405
  • [50] MNCATM: A Multi-Layer Non-Uniform Coding-Based Adaptive Transmission Method for 360° Video
    Li, Xiang
    Nie, Junfeng
    Zhang, Xinmiao
    Li, Chengrui
    Zhu, Yichen
    Liu, Yang
    Tian, Kun
    Guo, Jia
    ELECTRONICS, 2024, 13 (21)