Image-based augmented reality model for image-guided surgical simulation

Image-based information is helpful for image-guided surgery therapy using medical imaging devices. In this paper, we present an image-based augmented reality model for potential medical application. Firstly, texture image is generated from two orthogonal images with multi-resolution technique. The surface of a 3D head based on MRI images is flattened onto 2D plane with cylindrical projection method. Then line-pair 2D warping method is used to determine the feature-based positional relationship between the texture image and the flattened image. The information of anatomical structure from medical images can be preserved for the future medical application. Experimental results show that the method can photo-realistically render 3D face with texture mapping. Finally, simple patient-to-model registration is used to obtain interactive augmented reality display of a surgical simulation for a simulated cyst in corpus callosum.