A Real-time Visualization System of Pseudo-muscle Activity Using a VR Device

The goal of this research is to provide a real-time display of muscle activity in response to human motion input. We developed a system for real-time visualization of pseudo-muscle activity using a VR device. The user controls a CG avatar in VR space by inputting a body motion with the VR device. We constructed simplified models to output muscle activity corresponding to the posture of a CG avatar based on muscle-analysis data estimated from motion data. This system allows users to visualize the position of active muscles using a CG avatar in a VR space. This system can present different muscle activities depending on the input of elbow flexion/extension movement and the state of the upper limb at that time. The position of active muscles and the magnitude of their activity are represented by the color and expansion of the muscles on a CG avatar. By assigning controller input to other parts of the body rather than just the hands, users can move those parts in virtual space and visualize muscle activity.