Augmented Reality Visualization of Joint Movements for Rehabilitation and Sports Medicine

We present a visualization tool for human motion analysis in augmented reality. Our tool builds upon our previous work on joint biomechanical modelling for kinematic analysis, based on optical motion capture and personalized anatomical reconstruction of joint structures from medical imaging. It provides healthcare professionals with the in situ visualization of joint movements, where bones are accurately rendered as a holographic overlay on the subject - like if the user has an "X-ray vision" - and in real-time as the subject performs the movement. The tool also provides a recording mechanism for the examination and acquisition of movements and range of motion information. Recorded information can be for instance retrieved at a later moment to assess patient's progress in terms of kinematics during the rehabilitation phase. We also propose an intuitive non-sequential mean of navigating through recordings. It consists of pointing at movement trajectories for easy and intuitive retrieval of the meaningful portions of a movement. This tool allows for the post hoc replay and analysis of fast movements, such as from athletes movements in sports injury evaluation. Currently, hip and knee joints are supported.