Augmented Reality-Based Audio/Visual Surveillance System

There are immediate needs for audio/visual surveillance systems in a large number of areas including law enforcement, military, commercial, and personal security. A series of cameras connected to a local "monitoring center" via a wireless mesh network can provide instantaneous ad-hoc monitoring of several environments. However, there are several issues that must be resolved particularly when considering a large number of cameras monitoring a large area. In particular it is difficult to monitor and control such a large number of cameras and as a result, important events may be missed altogether In addition, some of these surveillance systems are set up in an instant ad-hoc manner which means that any operator monitoring the system can easily lose the sense of direction when switching between different camera views. To overcome these limitations, in this paper we describe an ongoing project that seeks the development of an instantaneous ad-hoc audio/visual-based mesh network surveillance system which incorporates an augmented-reality-based three-dimensional graphical user interface to efficiently control and monitor a large number of video surveillance cameras. The system also employs "intelligent vision" and "intelligent audio" techniques to automatically detect and monitor particular events (e.g., intruders entering the scene being monitored) in both the audio and video domain.