Classification, simplification and dynamic visualization of scene transition graphs for video browsing

被引:8
|
作者
Yeo, BL [1 ]
Yeung, MM [1 ]
机构
[1] IBM Corp, Thomas J Watson Res Ctr, Yorktown Heights, NY 10598 USA
关键词
Scene Transition Graph; graph simplification; video visualization; content analysis; digital library; video databases; video browsing; dynamic temporal display of video sequences;
D O I
10.1117/12.298470
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Scene Transition Graph (STG) [1] is a directed graph structure that compactly captures both image content and temporal flow of video. An STG offers a condensed view of the story content, serves as the summary of the clip represented, and allows nonlinear access to its story element. It can serve as a valuable tool for both the analysis of video structure and presentation of high level visual summary for video browsing applications. In this paper, we study new techniques for classification and simplification of the STG, and present better means of visualizing the graph through dynamic visual display and simplified structures. In other words, our techniques improve significantly the existing graph structure to enable more succinct presentation of the graphs which leads to more efficient utilization of the screen spaces. In addition, a technique that captures and presents visually the temporal dynamics of the video sequence is described. We have tested the graph visualization techniques on various programming types and the new tools are found to effectively handle video from a wider variety than the existing STG structure.
引用
收藏
页码:60 / 70
页数:11
相关论文
共 50 条
  • [1] VISUALIZATION OF VIDEO MOTION IN CONTEXT OF VIDEO BROWSING
    Schoeffmann, Klaus
    Lux, Mathias
    Taschwer, Mario
    Boeszoermenyi, Laszlo
    [J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 658 - 661
  • [2] Classification-Then-Grounding: Reformulating Video Scene Graphs as Temporal Bipartite Graphs
    Gao, Kaifeng
    Chen, Long
    Niu, Yulei
    Shao, Jian
    Xiao, Jun
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 19475 - 19484
  • [3] VIDEO BROWSING USING MOTION VISUALIZATION
    Schoeffmann, Klaus
    Taschwer, Mario
    Boeszoermenyi, Laszlo
    [J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1831 - 1832
  • [4] Dynamic simplification and visualization of large maps
    Mustafa, N
    Krishnan, S
    Varadhan, G
    Venkatasubramanian, S
    [J]. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2006, 20 (03) : 273 - 302
  • [5] Video Denoising and Simplification Via Discrete Regularization on Graphs
    Ghoniem, Mahmoud
    Chahir, Youssef
    Elmoataz, Abderrahim
    [J]. ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, PROCEEDINGS, 2008, 5259 : 380 - 389
  • [6] Interactive unsupervised classification and visualization for browsing an image collection
    Bruneau, Pierrick
    Picarougne, Fabien
    Gelgon, Marc
    [J]. PATTERN RECOGNITION, 2010, 43 (02) : 485 - 493
  • [7] Visualization of state transition graphs
    van Ham, F
    van de Wetering, H
    van Wijk, JJ
    [J]. IEEE SYMPOSIUM ON INFORMATION VISUALIZATION 2001, PROCEEDINGS, 2001, : 59 - 66
  • [8] Interactive, dynamic video browsing with the ZoomSlider interface
    Hürst, W
    Jarvers, P
    [J]. 2005 IEEE International Conference on Multimedia and Expo (ICME), Vols 1 and 2, 2005, : 558 - 561
  • [9] Visualization System to Analyze Browsing Trends of Internet Video Advertisements
    Miura, Rika
    Ohya, Hayato
    Itoh, Takayuki
    [J]. Proceedings of the International Conference on Information Visualisation, 2023, : 1 - 6
  • [10] Visualization System to Analyze Browsing Trends of Internet Video Advertisements
    Miura, Rika
    Ohya, Hayato
    Itoh, Takayuki
    [J]. 2023 27TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION, IV, 2023, : 1 - 6