Edge-Device Collaborative Rendering for Wireless Multi-User Interactive Virtual Reality in Metaverse

The immersive nature of the metaverse poses higher requirements on virtual reality (VR). In multi-user interactive VR, achieving real-time rendering of heterogeneous foreground objects with ultra-low latency is a challenge. In this paper, we propose an edge-device collaborative rendering framework based on the real-time computer graphics (CG) execution. We design a multi-object real-time rendering workflow and obtain the corresponding motion-to-photon (MTP) latency. We joint optimize the rendering positions of foreground objects and the bandwidth resource to minimize the MTP latency. A smooth maximum joint rendering scheme is proposed to address the non-differentiable objective function and convert the non-convex problem into convex subproblems. Numerical results illustrate that the proposed scheme significantly improves the frame rate by compensating the bottleneck term in the MTP latency.