Integrated design of intelligent surveillance systems and their user interface

Modern complex surveillance systems consisting of multiple and heterogeneous sensors, automatic information registration and data analysis techniques, and decision support tools should provide the human operator an integrated, transparent and easily comprehensible view of the surveyed scene. Displayed visual information should be optimally tuned to the characteristics and limitations of the human visual system. Interaction with the displayed information should be intuitive and effortless so that operators can focus their attention on their task. We present an overview of (1) display techniques that can be used to optimally adjust visual information presentation to the capabilities of the human visual system and the momentary direction of viewing, and (2) a range of techniques that allow optimal interaction with the displayed information. We argue that experts from the application domain, system designers and human factor specialists should all be involved in the design process of a complex surveillance system that incorporates these techniques, to ensure that the final product fully exploits all the technological opportunities and provides a cognitive fit between the displayed information and the operator's mental model.