Interactive System Based on Leap Motion for 3D Medical Model

An interactive visualization of the patients' 3D medical anatomical model as guide is often helpful for doctors during complex surgery. However, there are certain limitations according to the actual requirements of building sterile operating environment. Traditional human-computer interaction tools (mouse and keyboard) must be disinfected regularly and cannot be used in the process. A noncontact gesture control medical model based on Leap Motion is proposed in this study. The gesture is recognized and localized without using mouse and keyboards through a binocular camera assembled on Leap Motion. Hence, the model is directly controlled by the gesture to complete the operation of rotation, zoom, and other functions. In this study, a 3D heart model is combined with pseudo-color processing technology to enhance the observability of its 3D structure. Gesture recognition technology is then utilized to control the rendered model as rotation and zoom. Experimental results show that our system has an absolute accuracy in recognizing circle, swipe, and other actions. Thus, rotation is proposed as a new motion that can be identified steadily. Rotation plays an essential role in usability, intuition, and interactive efficiency of future system design. The system is applicable to sterile operating environments due to its stable recognition process and small space occupation.