A vision-based postproduction tool for footage logging, analysis, and annotation

We report a new method for logging and annotating video footage directed towards the needs of professional postproduction and archivist end users. SALSA-Semi-Automated Logging with Semantic Annotation-is a hybrid system that uses automated footage analysis for Cut detection and camera movement classification, and a stenographic-like keyboard input system for the logging of higher-level semantic information. Output is presented both in standard printed log form, with the addition of mosaic visual representations of shots, and in a fully searchable database. Experimental comparisons of SALSA with conventional hand analysis show a significant increase in the logger's speed with no reduction in accuracy or semantic detail. (c) 2005 Elsevier Inc. All rights reserved.