Object detection by spatio-temporal analysis and tracking of the detected objects in a video with variable background

被引:27
|
作者
Ray, Kumar S. [1 ]
Chakraborty, Soma [1 ]
机构
[1] Indian Stat Inst, 203 BT Rd, Kolkata 108, India
关键词
Variable background; Object detection; Gabor filter; Spatio-temporal analysis; Minimum Spanning Tree (MST); Object tracking; Linear Assignment Problem (LAP); Kalman filter; Occlusion; MOVING-OBJECTS; VISUAL TRACKING; SEGMENTATION; INTELLIGENCE; CAMERA; DESCRIPTORS; SUBTRACTION; FLUID;
D O I
10.1016/j.jvcir.2018.12.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we propose a novel approach for detecting and tracking objects in videos captured by moving cameras without any additional sensor. In such a video both the background and foreground change in each frame of the image sequence; making the separation of actual moving object from the background a challenging task. In this work, moving objects are detected as clusters of spatio-temporal blobs generated by spatio-temporal analysis of the image sequence using a three-dimensional Gabor filter and merged using Minimum Spanning Tree. Problem of data association during tracking is solved by Linear Assignment Problem and occlusion is handled by the application of Kalman filter. The major advantage of the proposed method is that, it does not require initialization or training on sample data to perform. Our algorithm demonstrated very satisfactory state-of-the-art result on benchmark videos. The performance of the algorithm is equivalent or superior to some benchmark algorithms. (C) 2018 Published by Elsevier Inc.
引用
收藏
页码:662 / 674
页数:13
相关论文
共 50 条
  • [21] Video Object Detection Using Object's Motion Context and Spatio-Temporal Feature Aggregation
    Kim, Jaekyum
    Koh, Junho
    Lee, Byeongwon
    Yang, Seungji
    Choi, Jun Won
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1604 - 1610
  • [22] A Novel Spatio-Temporal Video Object Segmentation Algorithm
    Zhu, Shiping
    Xia, Xi
    Zhang, Qingrong
    Belloulata, Kamel
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY, VOLS 1-5, 2008, : 1916 - +
  • [23] Efficient probabilistic spatio-temporal video object segmentation
    Ahmed, Rakib
    Karmakar, Gour C.
    Dooley, Laurence S.
    [J]. 6TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE, PROCEEDINGS, 2007, : 807 - +
  • [24] Spatio-Temporal Point Process for Multiple Object Tracking
    Wang, Tao
    Chen, Kean
    Lin, Weiyao
    See, John
    Zhang, Zenghui
    Xu, Qian
    Jia, Xia
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (04) : 1777 - 1788
  • [25] Video Text Tracking With a Spatio-Temporal Complementary Model
    Gao, Yuzhe
    Li, Xing
    Zhang, Jiajian
    Zhou, Yu
    Jin, Dian
    Wang, Jing
    Zhu, Shenggao
    Bai, Xiang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 9321 - 9331
  • [26] Spatio-temporal video search using the object based video representation
    Zhong, D
    Chang, SF
    [J]. INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL I, 1997, : 21 - 24
  • [27] Spatio-Temporal AutoEncoder for Video Anomaly Detection
    Zhao, Yiru
    Deng, Bing
    Shen, Chen
    Liu, Yao
    Lu, Hongtao
    Hua, Xian-Sheng
    [J]. PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, : 1933 - 1941
  • [28] Towards Robust Object Detection: Integrated Background Modeling Based on Spatio-temporal Features
    Tanaka, Tatsuya
    Shimada, Atsushi
    Taniguchi, Rin-ichiro
    Yamashita, Takayoshi
    Arita, Daisaku
    [J]. COMPUTER VISION - ACCV 2009, PT I, 2010, 5994 : 201 - +
  • [29] Video anomaly detection with spatio-temporal dissociation
    Chang, Yunpeng
    Tu, Zhigang
    Xie, Wei
    Luo, Bin
    Zhang, Shifu
    Sui, Haigang
    Yuan, Junsong
    [J]. PATTERN RECOGNITION, 2022, 122
  • [30] A Fast Algorithm for Tracking Moving Objects Based on Spatio-Temporal Video Segmentation and Cluster Ensembles
    Monma, Yumi
    Silva, Luciano S.
    Scharcanski, Jacob
    [J]. 2015 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2015, : 29 - 34