ACCESSMATH: INDEXING AND RETRIEVING VIDEO SEGMENTS CONTAINING MATH EXPRESSIONS BASED ON VISUAL SIMILARITY

被引:0
|
作者
Davila, Kenny [1 ]
Agarwal, Anurag [2 ]
Gaborski, Roger [1 ]
Zanibbi, Richard [1 ]
Ludi, Stephanie [3 ]
机构
[1] Rochester Inst Technol, Dept Comp Sci, Rochester, NY 14623 USA
[2] Rochester Inst Technol, Sch Math Sci, Rochester, NY 14623 USA
[3] Rochester Inst Technol, Software Engn, Rochester, NY 14623 USA
关键词
Math Retrieval; Content-Based Image Retrieval; Sketch-Based Image Retrieval;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
AccessMath project is a work in progress oriented toward helping visually impaired students in and out of the classroom. The system works with videos from math lectures. For each lecture, videos of the whiteboard content from two different sources are provided. An application for extraction and retrieval of that content is presented. After the content has been indexed, the user can select a portion of the whiteboard content found in a video frame and use it as a query to find segments of video with similar content. Graphs of neighboring connected components are used to describe both the query and the candidate regions, and the results of a query are ranked using the recall of matched graph edges between the graph of the query and the graph of each candidate. This is a recognition-free method and belongs to the field of sketchbased image retrieval.
引用
收藏
页码:14 / 17
页数:4
相关论文
共 20 条
  • [1] A people similarity based approach to video indexing
    Wang, P
    Ma, YF
    Zhang, HJ
    Yang, SQ
    [J]. 2003 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL III, PROCEEDINGS: IMAGE & MULTIDIMENSIONAL SIGNAL PROCESSING SIGNAL, PROCESSING EDUCATION, 2003, : 693 - 696
  • [2] Distributed video documents indexing and content-based retrieving
    Mostefaoui, A
    Favory, L
    [J]. PROTOCOLS AND SYSTEMS FOR INTERACTIVE DISTRIBUTED MULTIMEDIA, PROCEEDINGS, 2002, 2515 : 190 - 201
  • [3] Actor based video indexing and retrieval using visual information
    Islam, Mohammad Khairul
    Lee, Soon-Tak
    Baek, Joong-Hwan
    [J]. ADVANCES IN NATURAL COMPUTATION, PT 2, 2006, 4222 : 492 - 501
  • [4] A Survey on Visual Content-Based Video Indexing and Retrieval
    Hu, Weiming
    Xie, Nianhua
    Li, Li
    Zeng, Xianglin
    Maybank, Stephen
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2011, 41 (06): : 797 - 819
  • [5] Speaker dependent video indexing based on audio-visual interaction
    Tsekeridou, S
    Pitas, I
    [J]. 1998 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL 1, 1998, : 358 - 362
  • [6] Content-based video parsing and indexing based on audio-visual interaction
    Tsekeridou, S
    Pitas, I
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2001, 11 (04) : 522 - 535
  • [7] A generic framework for semantic video indexing based on visual concepts/contexts detection
    Nizar Elleuch
    Anis Ben Ammar
    Adel M. Alimi
    [J]. Multimedia Tools and Applications, 2015, 74 : 1397 - 1421
  • [8] Audio-visual content analysis for content-based video indexing
    Tsekeridou, S
    Pitas, I
    [J]. IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS, PROCEEDINGS VOL 1, 1999, : 667 - 672
  • [9] Audio-visual content analysis for content-based video indexing
    Tsekeridou, Sofia
    Pitas, Ioannis
    [J]. International Conference on Multimedia Computing and Systems -Proceedings, 1999, 1 : 667 - 672
  • [10] A generic framework for semantic video indexing based on visual concepts/contexts detection
    Elleuch, Nizar
    Ben Ammar, Anis
    Alimi, Adel M.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (04) : 1397 - 1421