Game Theory-driven Rate Control for 360-Degree Video Coding

被引:3
|
作者
Zhao, Tiesong [1 ,2 ]
Lin, Jielian [1 ]
Song, Yanjie [1 ]
Wang, Xu [3 ]
Niu, Yuzhen [1 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
[3] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Rate Control (RC); rate allocation; video coding; 360-degree video; omnidirectional video; perceptual quality; LEVEL RATE CONTROL; OPTIMAL BIT ALLOCATION; OPTIMIZATION; QUALITY; ALGORITHM;
D O I
10.1145/3474085.3475657
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The 360-degree video (omnidirectional video) has become popular recently due to its capability of providing immersive experience, which is generally achieved via spherical moving pictures with freedom of viewpoint changing. Nevertheless, the support of fullview visual contents has inevitably reshaped its perceptual quality metric and dramatically increased its bitrate output after video coding. Therefore in 360-degree video coding, the Rate Control (RC) problem, which aims to maximize the resulted perceptual quality under bitrate constraint, has become a challenging task yet to be addressed. In this paper, we observe a latitude-based bitrate discrepancy in equirectangular-projected 360-degree video coding and further utilize this feature in bitrate allocation under panoramic vision. We introduce game theory to find optimal inter/intra-frame bit allocations that maximize the overall RC performance in terms of utility function. Finally, an overall framework is proposed that is capable of providing both an improved bitrate accuracy and an enhanced perceptual quality. Experimental results demonstrate the efficiency of proposed method, with promising RC performances for 4K and 8K 360-degree videos.
引用
收藏
页码:3998 / 4006
页数:9
相关论文
共 50 条
  • [31] Viewport Margins for 360-Degree Immersive Video
    Curcio, Igor D. D.
    Ahsan, Saba
    [J]. 2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [32] 360-Degree Video Head Movement Dataset
    Corbillon, Xavier
    De Simone, Francesca
    Simon, Gwendal
    [J]. PROCEEDINGS OF THE 8TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'17), 2017, : 199 - 204
  • [33] Stereoscopic realtime 360-degree video stitching
    Limonov, Alexander
    Yu, Xiao
    Juan, Lei
    Lei, Cao
    Jian, Yang
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2018,
  • [34] A 360-degree Panoramic Video System Design
    Huang, Kai-Chen
    Chien, Po-Yu
    Chien, Cheng-An
    Chang, Hsiu-Cheng
    Guo, Jiun-In
    [J]. 2014 INTERNATIONAL SYMPOSIUM ON VLSI DESIGN, AUTOMATION AND TEST (VLSI-DAT), 2014,
  • [35] JOINT REINFORCEMENT LEARNING AND GAME THEORY BITRATE CONTROL METHOD FOR 360-DEGREE DYNAMIC ADAPTIVE STREAMING
    Wei, Xuekai
    Zhou, Mingliang
    Kwong, Sam
    Yuan, Hui
    Xiang, Tao
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4230 - 4234
  • [36] A Hierarchical Buffer Management Approach to Rate Adaptation for 360-Degree Video Streaming
    Jiang, Zhiqian
    Zhang, Xu
    Huang, Wei
    Chen, Hao
    Xu, Yiling
    Hwang, Jenq Neng
    Ma, Zhan
    Sun, Jun
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (02) : 2157 - 2170
  • [37] CONTENT-ADAPTIVE 360-DEGREE VIDEO CODING USING HYBRID CUBEMAP PROJECTION
    He, Yuwen
    Xiu, Xiaoyu
    Hanhart, Philippe
    Ye, Yan
    Duanmu, Fanyi
    Wang, Yao
    [J]. 2018 PICTURE CODING SYMPOSIUM (PCS 2018), 2018, : 313 - 317
  • [38] Discrete Cosine Basis Oriented Homogeneous Motion Discovery for 360-Degree Video Coding
    Ahmmed, Ashek
    Paul, Manoranjan
    [J]. IMAGE AND VIDEO TECHNOLOGY (PSIVT 2019), 2019, 11854 : 106 - 115
  • [39] Fast intra partition and mode prediction for equirectangular projection 360-degree video coding
    Shu Zheng-Jie
    Peng Zong-Ju
    Jiang Gang-Yi
    Chen Fen
    Yuan Bo-Sen
    [J]. IET IMAGE PROCESSING, 2023, 17 (02) : 558 - 569
  • [40] Buffer Based Adaptation Using Scalable Video Coding for 360-Degree Video Streaming over NDN
    Ogasawara, Taku
    Bandai, Masaki
    [J]. 2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 142 - 145