3D-Visualization of Ultrasonic NDT Data Using Mixed Reality

In this paper we present an approach where ultrasonic testing data (UT) is linked with its spatial coordinates and direction vector to the examined specimen. Doing so, the processed nondestructive testing (NDT) results can be visualized directly on the sample in real-time using augmented or virtual reality. To enable the link between NDT data and physical object, a 3D-tracking system is used. Spatial coordinates and NDT sensor data are stored together. For visualization, texture mapping was applied on a 3D model. The testing process consists of data recording, processing and visualization. All three steps are performed in real-time. The data is recorded by an UT-USB interface, processed on a PC workstation and displayed using a Mixed-Reality-system (MR). Our system allows real-time 3D visualization of ultrasonic NDT data, which is directly drawn into the virtual representation. Therefore, the possibility arises to assist the operator during the manual testing process. This new approach results in a much more intuitive testing process and a data set optimally prepared to be saved in a digital twin environment. The size of the samples is not limited to a laboratory scale, but also works for larger objects, e.g. a helicopter fuselage. Our approach is inspired by concepts of NDE 4.0 to create a new kind of smart inspection systems.