Multimedia/multimodal signal processing, analysis, and understanding

Multimodal refers to the different senses (visual, audio, tactile, etc.) used in human-computer interface. "Multimedia" refers to the different ways of representing information (text, graphics, audio, images, video, etc.). A signal processing, analysis, or understanding task is called Multimedia/Multimodal, if it involves two or more modalities or media, interacting in nontrivial ways. We shall give an array of examples of multimedia/multimodal signal processing, analysis, and understanding; including: Audio/visual speech recognition, and audio/visual emotion recognition. A stable and robust facial movement tracking algorithm will be presented, which is used in both tasks.