A Novel Video Annotation Framework Based on Video Object

被引:2
|
作者
Li, Yang [1 ]
Lu, Jianjiang [1 ]
Zhang, Yafei [1 ]
Li, Ran [1 ]
Zhou, Bo [1 ]
机构
[1] PLA Univ Sci & Technol, Inst Command Automat, Nanjing 210007, Peoples R China
关键词
video annotation; video object; video analysis; active learning; IMAGE RETRIEVAL;
D O I
10.1109/JCAI.2009.32
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video annotation is very important for video management, such as video retrieval. Despite continuous efforts in inventing new annotation algorithms, the annotation performance is usually unsatisfactory, and the annotation vocabulary is still limited due to the use of a small scale training set. In this paper, a novel video annotation framework based on the video object is presented, named Object-Based Video Annotation. By dividing video into three types, we deal with different kind of video in different way. The first kind of video was annotated by human base on the e-Annotation architecture. The second kind of video was automatically annotated by the web mining methods. The third kind of vi eo annotated by video analysis model which detect the video object and label them at the same time. Then active learning model implement active learning method in the video database, which can add new labels and video in the database. We also present an application system based on annotations: video retrieval. At the same time we add relevance feedback in our framework to optimize the result. The system designed base on a real-world situation by including video gathered from the Internet and is designed for exploratory video retrieval system based on the internet.
引用
收藏
页码:572 / 575
页数:4
相关论文
共 50 条
  • [31] Large-Scale Training Framework for Video Annotation
    Hwang, Seong Jae
    Lee, Joonseok
    Varadarajan, Balakrishnan
    Gordon, Ariel
    Xu, Zheng
    Natsev, Apostol
    KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 2394 - 2402
  • [32] A Framework for Review, Annotation, and Classification of Continuous Video in Context
    Lensing, Tobias
    Dickmann, Lutz
    Beauregard, Stephane
    SMART GRAPHICS, PROCEEDINGS, 2009, 5531 : 290 - 294
  • [33] SAGES consensus recommendations on an annotation framework for surgical video
    Ozanan R. Meireles
    Guy Rosman
    Maria S. Altieri
    Lawrence Carin
    Gregory Hager
    Amin Madani
    Nicolas Padoy
    Carla M. Pugh
    Patricia Sylla
    Thomas M. Ward
    Daniel A. Hashimoto
    Surgical Endoscopy, 2021, 35 : 4918 - 4929
  • [34] SAGES consensus recommendations on an annotation framework for surgical video
    Meireles, Ozanan R.
    Rosman, Guy
    Altieri, Maria S.
    Carin, Lawrence
    Hager, Gregory
    Madani, Amin
    Padoy, Nicolas
    Pugh, Carla M.
    Sylla, Patricia
    Ward, Thomas M.
    Hashimoto, Daniel A.
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2021, 35 (09): : 4918 - 4929
  • [35] An automatic video annotation framework based on two level keyframe extraction mechanism
    Aote, Shailendra S.
    Potnurwar, Archana
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (11) : 14465 - 14484
  • [36] Workflow for integrated object detection in collaborative video annotation environments
    Grunewaldt, Lars
    Moeller, Kim
    Morisse, Karsten
    COMPUTATIONAL SCIENCE - ICCS 2006, PT 2, PROCEEDINGS, 2006, 3992 : 565 - 572
  • [37] An automatic video annotation framework based on two level keyframe extraction mechanism
    Shailendra S. Aote
    Archana Potnurwar
    Multimedia Tools and Applications, 2019, 78 : 14465 - 14484
  • [38] Automatic Pass Annotation from Soccer Video Streams Based on Object Detection and LSTM
    Sorano, Danilo
    Carrara, Fabio
    Cintia, Paolo
    Falchi, Fabrizio
    Pappalardo, Luca
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE AND DEMO TRACK, ECML PKDD 2020, PT V, 2021, 12461 : 475 - 490
  • [39] A Novel Framework for Semantic-based Video Retrieval
    Nan, Xiaoming
    Zhao, Zhicheng
    Cai, Anni
    Xie, Xiaohui
    2009 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INTELLIGENT SYSTEMS, PROCEEDINGS, VOL 4, 2009, : 415 - +
  • [40] A novel framework of FIGS video coding based on EBCOT
    Jianlong Zhang
    Xinbo Gao
    SATELLITE DATA COMPRESSION, COMMUNICATIONS, AND ARCHIVING III, 2007, 6683