Game Theory-driven Rate Control for 360-Degree Video Coding

被引:3
|
作者
Zhao, Tiesong [1 ,2 ]
Lin, Jielian [1 ]
Song, Yanjie [1 ]
Wang, Xu [3 ]
Niu, Yuzhen [1 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Rate Control (RC); rate allocation; video coding; 360-degree video; omnidirectional video; perceptual quality; LEVEL RATE CONTROL; OPTIMAL BIT ALLOCATION; OPTIMIZATION; QUALITY; ALGORITHM;
D O I
10.1145/3474085.3475657
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The 360-degree video (omnidirectional video) has become popular recently due to its capability of providing immersive experience, which is generally achieved via spherical moving pictures with freedom of viewpoint changing. Nevertheless, the support of fullview visual contents has inevitably reshaped its perceptual quality metric and dramatically increased its bitrate output after video coding. Therefore in 360-degree video coding, the Rate Control (RC) problem, which aims to maximize the resulted perceptual quality under bitrate constraint, has become a challenging task yet to be addressed. In this paper, we observe a latitude-based bitrate discrepancy in equirectangular-projected 360-degree video coding and further utilize this feature in bitrate allocation under panoramic vision. We introduce game theory to find optimal inter/intra-frame bit allocations that maximize the overall RC performance in terms of utility function. Finally, an overall framework is proposed that is capable of providing both an improved bitrate accuracy and an enhanced perceptual quality. Experimental results demonstrate the efficiency of proposed method, with promising RC performances for 4K and 8K 360-degree videos.
引用
收藏
页码:3998 / 4006
页数:9
相关论文
共 50 条
  • [1] Virtual-Competitors-Based Rate Control for 360-Degree Video Coding
    Lin, Jielian
    Lin, Hongbin
    Xu, Yiwen
    Kang, Yuanxun
    Zhao, Tiesong
    [J]. IEEE TRANSACTIONS ON BROADCASTING, 2024, 70 (01) : 357 - 365
  • [2] λ-Domain Perceptual Rate Control for 360-Degree Video Compression
    Li, Li
    Yan, Ning
    Li, Zhu
    Liu, Shan
    Li, Houqiang
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (01) : 130 - 145
  • [3] SPHERICAL DOMAIN RATE-DISTORTION OPTIMIZATION FOR 360-DEGREE VIDEO CODING
    Li, Yiming
    Xu, Jizheng
    Chen, Zhenzhong
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 709 - 714
  • [4] An Adaptive Quantization Method for 360-degree Video Coding
    Xiu, Xiaoyu
    He, Yuwen
    Ye, Yan
    [J]. APPLICATIONS OF DIGITAL IMAGE PROCESSING XLI, 2018, 10752
  • [5] Viewport-adaptive 360-degree video coding
    Hu, Qiang
    Zhou, Jun
    Zhang, Xiaoyun
    Shi, Zhiru
    Gao, Zhiyong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (17-18) : 12205 - 12226
  • [6] Viewport-adaptive 360-degree video coding
    Qiang Hu
    Jun Zhou
    Xiaoyun Zhang
    Zhiru Shi
    Zhiyong Gao
    [J]. Multimedia Tools and Applications, 2020, 79 : 12205 - 12226
  • [7] Adaptive 360-Degree Video Streaming using Scalable Video Coding
    Nasrabadi, Afshin Taghavi
    Mahzari, Anahita
    Beshay, Joseph D.
    Prakash, Ravi
    [J]. PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1689 - 1697
  • [8] Adaptive 360-Degree Video Streaming using Layered Video Coding
    Nasrabadi, Afshin Taghavi
    Mahzari, Anahita
    Beshay, Joseph D.
    Prakash, Ravi
    [J]. 2017 IEEE VIRTUAL REALITY (VR), 2017, : 347 - 348
  • [9] Analysis of Neural Video Compression Networks for 360-Degree Video Coding
    Regensky, Andy
    Brand, Fabian
    Kaup, Andre
    [J]. 2024 PICTURE CODING SYMPOSIUM, PCS 2024, 2024,
  • [10] Spherical Position Dependent Rate-Distortion Optimization for 360-degree Video Coding
    Liu, Yuyang
    Guo, Hongwei
    Zhu, Ce
    Liu, Yipeng
    [J]. 2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 992 - 996