Cloud Mobile 3D Display Gaming User Experience Modeling and Optimization by Asymmetric Graphics Rendering

被引:6
|
作者
Lu, Yao [1 ]
Liu, Yao [1 ]
Dey, Sujit [1 ]
机构
[1] Univ Calif San Diego, Mobile Syst Design Lab, Dept Elect & Comp Engn, La Jolla, CA 92093 USA
基金
美国国家科学基金会;
关键词
3D; asymmetric graphics rendering; branch and bound; cloud Mobile Gaming; subjective testing; user experience;
D O I
10.1109/JSTSP.2015.2396475
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the arrival of auto-stereoscopic 3D displays for mobile devices, and emergence of more 3D content, there is much anticipation for 3D mobile multimedia experiences, including 3D display gaming. Simultaneously, with the emergence of cloud computing, more mobile applications are being developed to take advantage of the elastic cloud resources. In this paper, we explore the possibility of developing Cloud Mobile 3D Display Gaming, where the 3D video rendering and encoding is performed on cloud servers, with the resulting 3D video streamed over wireless networks to mobile devices with 3D displays for a true 3D mobile gaming experience. However, with the significantly higher bitrate requirement for 3D video, ensuring user experience may be a challenge, both in terms of 3D video quality and network delay (response time), considering the bandwidth constraints and fluctuations of wireless networks. In this paper, we propose a new asymmetric graphics rendering approach which can significantly reduce the video encoding bitrate needed for a certain video quality, thereby making it easier to transmit the video over wireless network. However, since asymmetric graphics rendering may also impair the graphics quality, we need to be able to understand and measure its impact. We conduct subjective tests to study and model the impairments due to asymmetric graphics rendering and network delay, thereby developing a user experience model for cloud based mobile 3D display gaming. By conducting subsequent subjective tests, we prove the correctness of the impairment functions and the resulting user experience model. Furthermore, given any network condition, we propose to solve the problem of selecting the optimal graphics rendering factors for the left and right views so as to maximize user experience of cloud mobile 3D display gaming. In order to solve this problem, we first develop a model to estimate the resulting video bitrate of the rendered 3D video when certain graphics rendering factors are used. Next, we derive a model to predict the delay given the available network bandwidth and the video bitrate of the rendered 3D video. We use the above two models together with a branch and bound algorithm to solve the optimization problem and determine the optimal values for the left and right view rendering factors. Experiments conducted using real 4G-LTE network profiles on commercial cloud service demonstrate the feasibility of significant improvement in user experience when the proposed optimization algorithm is used to dynamically select optimal rendering factors according to changing network conditions.
引用
收藏
页码:517 / 532
页数:16
相关论文
共 50 条
  • [1] Enhancing Cloud Mobile 3D Display Gaming User Experience by Asymmetric Graphics Rendering
    Lu, Yao
    Liu, Yao
    Dey, Sujit
    [J]. 2014 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS (ICNC), 2014, : 368 - 374
  • [2] A Joint Asymmetric Graphics Rendering and Video Encoding Approach for Optimizing Cloud Mobile 3D Display Gaming User Experience
    Lu, Yao
    Liu, Yao
    Dey, Sujit
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2015, : 421 - 428
  • [3] Asymmetric and selective object rendering for optimized Cloud Mobile 3D Display Gaming user experience
    Lu, Yao
    Liu, Yao
    Dey, Sujit
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (18) : 18291 - 18320
  • [4] Asymmetric and selective object rendering for optimized Cloud Mobile 3D Display Gaming user experience
    Yao Lu
    Yao Liu
    Sujit Dey
    [J]. Multimedia Tools and Applications, 2017, 76 : 18291 - 18320
  • [5] Optimizing Cloud Mobile 3D Display Gaming User Experience by Asymmetric Object of Interest Rendering
    Lu, Yao
    Liu, Yao
    Dey, Sujit
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2015, : 6842 - 6848
  • [6] JAVRE: A Joint Asymmetric Video Rendering and Encoding Approach to Enable Optimized Cloud Mobile 3D Virtual Immersive User Experience
    Lu, Yao
    Dey, Sujit
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2016, 6 (04) : 544 - 559
  • [7] Cloud Mobile Gaming: Modeling and Measuring User Experience in Mobile Wireless Networks
    Wang, Shaoxuan
    Dey, Sujit
    [J]. MOBILE COMPUTING AND COMMUNICATIONS REVIEW, 2012, 16 (01) : 10 - 21
  • [8] Power Consumption Optimization for 3D Graphics Rendering
    Lidong Xing
    Tao Li
    Hucai Huang
    Jungang Han
    [J]. Journal of Harbin Institute of Technology(New series), 2019, 26 (01) : 42 - 50
  • [9] Modeling and Characterizing User Experience in a Cloud Server Based Mobile Gaming Approach
    Wang, Shaoxuan
    Dey, Sujit
    [J]. GLOBECOM 2009 - 2009 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-8, 2009, : 4231 - 4237
  • [10] Optimization of 3D Rendering in Mobile Devices
    Marek, Tomas
    Krejcar, Ondrej
    [J]. MOBILE WEB AND INTELLIGENT INFORMATION SYSTEMS, 2015, 9228 : 37 - 48