Video clustering using spatio-temporal image with fixed length

In order to handle video media such as TV programs efficiently and effectively, we need to segment a video stream into video segments and structuralize them based on their contents. In this paper, we focus on the similarity, which is one of the important relations between video segments, and describe a method to cluster similar segments in a video stream. The conventional clustering methods were based on shots, but no complete method to detect shot boundaries has been established yet. Alternatively, our method is based on fixed length video stream segments, called video packets. Generating spatio-temporal images, we employ co-occurrence matrices to express the feature in the time dimension explicitly. From clustering experiments for actual TV programs, we obtained the clustering accuracy of 81%.