Development of Quick Three-Dimensional Shape Measurement Projection Mapping System Using a Whole-Space Tabulation Method

A grating projection method is often used as a highly accurate 3D shape measurement method. A real-time 3D shape measurement system can also be applied to measure a wide and smooth curved surface, such as in sheet metal processing. In this case, operators take much effort to recognize the positions of some problem areas on an object from a measured result displayed on a monitor. This study develops a projection mapping system projecting an evaluation image, such as height, displacement, gradient, curvature factor, and area of defect, onto an object. These evaluation results are obtained from the measured 3D shape. The evaluation image should be deformed according to the 3D shape of the object because the camera and projector positions are different. Therefore, this study proposes a method to quickly produce a deformed evaluation image using a whole-space tabulation method. A coordinate transform table allowed the conversion of a camera pixel coordinate into a projector pixel coordinate by using reference planes to apply deformation to the evaluation image according to the measured 3D shape. The quick coordinate transformation from a camera pixel coordinate into a projector pixel coordinate was realized using the coordinate transform table. This is a key idea of this study. It was confirmed that the coordinate transformation from the camera pixel coordinate to the projector coordinate could be performed in 4.5 ms using the coordinate transform table. In addition, 3D shape measurement projection mapping was applied to a curved sheet metal with small deformation, and the deformation part was clearly shown by projecting the height distribution. The architecture and the experimental results are shown herein.