Multimodal recognition based on fusion of ear and profile face

Ear recognition is proved to be a new and promising authentication technique. Because of ear's special physiological structure and location, it is reasonable to combine ear with profile face for recognition in such scenarios as frontal face images are not available. In this paper, a novel non-intrusive multimodal recognition technology based on ear and profile face is proposed. First, only the face profile-view images are captured for recognition. Then ear classifier and profile face classifier based on Full-Space Linear Discriminant Analysis (FSLDA) are set up. Finally decision fusion of ear and profile face is carried out using the combination methods of Product, Sum and Median rules according to the Bayesian theory and a modified Vote rule for two classifiers is presented The results of experiment show that the recognition rate is higher than that of the recognition adopting the single feature, and that the recognition range is larger than that of both uni-modality.