Fast and adaptive semantic object extraction from video

Semantic video object identification and extraction is an important component for content-based multimedia applications such as editing, coding and retrieval. A smart interactive video object generation (SIVOG) system based on adaptive processing and semantic user interaction was developed in our previous work. SIVOG is further improved to efficiently process video content based on semantic object's spatial and temporal characteristics in this work. The enhanced SIVOG system adaptively selects processing regions based on the object shape. Temporal skipping and interpolation procedures are applied to objects that have a slow motion activity. This system can extract simple semantic objects in real time with pixel-wise accuracy. Fast, accurate and consistent results are obtained in the experiment when the system is evaluated with several MPEG-4 test sequences.