Important Nonverbal Attributes for Spontaneous Speech Recognition

Understanding human emotions and their nonverbal messages is one of the most necessary and important abilities for making the next generation of human-computer interfaces (HCI) easier, more natural and effective. The main goal of this paper is to compare different methods to combine the results of both classifiers - both paralanguage and facial expressions. A prototype of the dialog system was developed in the Department of Computer Science. The proposed system is fully automatic, users independent and real-time working. Several experiments show that the speech recognition quality is increased by using nonverbal information. The work presented in this paper was supported by the project number 2C06009.