Real-time facial expression recognition using a fuzzy emotion model

This paper presents the fuzzy video based emotion recognition system VISBER, that allows to analyze facial expressions in video sequences. In order to process images in real-time a tracking mechanism is used for face localization. The fuzzy classification itself analyzes the deformation of a face separately in each image. In contrast to most existing approaches, also blended emotions with varying intensities as proposed by psychologists can be handled. For this purpose we propose a fuzzy emotion model which is generally applicable for also for other emotion recognition solutions. Furthermore, VISBER supports the automatic adaptation to the characteristics of individual human faces by a short training phase that can be done before the emotion recognition starts.