Margin Preserving Projection for Image Set Based Face Recognition

Face images are usually taken from different camera views with different expressions and illumination. Face recognition based on Image set is expected to achieve better performance than traditional single frame based methods, because this new framework can incorporate information about variations of individual's appearance and make a decision collectively. In this paper we propose a new dimensionality reduction method for image set based face recognition. In the proposed method, we transform each image set into a convex hull and use support vector machine to compute margins between each pair sets. Then we use PCA to do dimension reduction with an aim to preserve those margins. Finally we do classification using a distance based on convex hull in low dimension feature space. Experiments with benchmark face video databases validate the proposed approach.