A robust and fast face modeling system

In this paper, we describe our face modeling system which allows a user, with a PC and an ordinary video camera, to construct their own 3D face models with minimal manual work. Furthermore, the constructed face model can be animated right away. There are two technical innovations that make our system possible. The first is a robust head motion estimation algorithm that takes advantage of physical properties of the face feature points obtained from manual marking to reduce the number of unknowns. The second innovation is to fit a set of face metrics (313 deformation vectors) to the reconstructed 3D points and markers to generate a complete face geometry. We have done live demonstrations many times and constructed 3D faces for hundreds of people. The system has proven to be robust, fast, and easy to use.