Remarks on 3D human posture estimation system using simple multi-camera system

This paper proposes a human body posture estimation method based on back projection of human silhouette images extracted from multi-camera images. To extract human silhouettes from color images accurately, a real-time background subtraction method that utilized the brightness and chromaticity in RGB color system for each pixel of the color image is proposed. The threshold values for the brightness and the chromaticity are statistically defined in advance from the image sequence of a background. The pixel classification rules considering the brightness, chromaticity, and their threshold values, classify each pixel of an image observing a human with the background into the human silhouette or not. Using the obtained human silhouette images, a 3D human body posture reconstruction in real-time with silhouette volume intersection is also investigated. To evaluate the feasibility of our proposed human body posture estimation method, 3D reconstruction experiments of human body posture are carried out. The experimental system with a personal computer and three CCD cameras under single processing scheme is composed and the experimental results confirm both the feasibility and effectiveness of the proposed background subtraction method and the 31) reconstruction method in real-time.