Time-based feedback-control framework for real-time video surveillance systems with utilization control

Multi-camera surveillance systems generally are used by intelligent vision applications to analysis moving objects in the urban environments. Object tracking is an essential component of these applications. Real-time tracking of moving objects in the crowded urban scenes is a challenging problem because the number of moving objects in the scene varies and is usually unpredictable. In order to meet the real-time requirements of intelligent vision applications, it is necessary to control the surveillance workload over processing system and enforce the utilization bound on the system. The utilization control is challenging especially when the workload in the system is unpredictable. The workload for a particular camera depending on the number of targets in its view and execution rate of services that are used to detect and track the moving objects. In this paper, an adaptive real-time system based on the feedback-control framework is proposed to control the system utilization by adjusting input video frame rate that guarantees real-time performance and quality of intelligent vision applications. This approach can handle the workload uncertainties by identifying the parameters of system model online by solving an optimization problem and can simultaneously adjust the frame rate in each sampling period. In each sampling instance, the system utilization is monitored and the error is obtained by comparing it with the set point. The real-time operation of the computing system is achieved by adjusting the input video frame rate to keep the utilization at a given set point slightly below their schedulable bound. Evaluation results demonstrate proposed scheme outperforms the existing schemes especially under workload uncertainties.