Segmenting, modeling, and matching video clips containing multiple moving objects

被引:28
|
作者
Rothganger, Fred
Lazebnik, Svetlana
Schmid, Cordelia
Ponce, Jean
机构
[1] Sandia Natl Labs, Albuquerque, NM 87123 USA
[2] Beckman Inst, Urbana, IL 61801 USA
[3] INRIA Rhone Alpes, F-38330 Montbonnot St Martin, France
[4] Ecole Normale Super, Dept Informat, F-75230 Paris 05, France
[5] Univ Illinois, Dept Comp Sci, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
affine-covariant patches; structure from motion; motion segmentation; shot matching; video retrieval;
D O I
10.1109/TPAMI.2007.57
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel representation for dynamic scenes composed of multiple rigid objects that may undergo different motions and are observed by a moving camera. Multiview constraints associated with groups of affine-covariant scene patches and a normalized description of their appearance are used to segment a scene into its rigid components, construct three-dimensional models of these components, and match instances of models recovered from different image sequences. The proposed approach has been applied to the detection and matching of moving objects in video sequences and to shot matching, i.e., the identification of shots that depict the same scene in a video clip.
引用
收藏
页码:477 / 491
页数:15
相关论文
共 50 条
  • [1] Segmenting, modeling, and matching video clips containing multiple moving objects
    Rothganger, F
    Lazebnik, S
    Schmid, C
    Ponce, J
    PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, 2004, : 914 - 921
  • [2] Modeling background and segmenting moving objects from compressed video
    Wang, Weiqiang
    Yang, Jie
    Gao, Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2008, 18 (05) : 670 - 681
  • [3] Moving Objects Detection in Birds Video Based on Multiple Block Matching
    Li, Yan
    Yin, Yongyi
    ICCIT: 2009 FOURTH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND CONVERGENCE INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2009, : 1262 - 1265
  • [4] Modeling of moving objects in a video database
    Li, JZ
    Ozsu, MT
    Szafron, D
    IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS '97, PROCEEDINGS, 1997, : 336 - 343
  • [5] RECURSIVE KERNEL DENSITY ESTIMATION FOR MODELING THE BACKGROUND AND SEGMENTING MOVING OBJECTS
    Zhu, Qingsong
    Shao, Ling
    Li, Qi
    Xie, Yaoqin
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 1769 - 1772
  • [6] Mosaic of a video shot with multiple moving objects
    Fusiello, A
    Aprile, M
    Marzotto, R
    Murino, V
    2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 2, PROCEEDINGS, 2003, : 307 - 310
  • [7] Detection and tracking of multiple moving objects in video
    Huang, Wei
    Wu, Jonathan
    VISAPP 2007: PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOLUME IU/MTSV, 2007, : 492 - +
  • [8] Detecting and segmenting multiple moving objects using level-set method
    Yu, Hui-Min
    You, Yu-Sai
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2007, 41 (03): : 412 - 417
  • [9] The new modeling for semantic representation of moving objects in video
    Choi, Chang
    Cho, Miyoung
    Kim, Pankoo
    9TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY: TOWARD NETWORK INNOVATION BEYOND EVOLUTION, VOLS 1-3, 2007, : 363 - +
  • [10] Modeling moving objects over multiple granularities
    Hornsby, K
    Egenhofer, MJ
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2002, 36 (1-2) : 177 - 194