Object detection by spatio-temporal analysis and tracking of the detected objects in a video with variable background

被引:27
|
作者
Ray, Kumar S. [1 ]
Chakraborty, Soma [1 ]
机构
[1] Indian Stat Inst, 203 BT Rd, Kolkata 108, India
关键词
Variable background; Object detection; Gabor filter; Spatio-temporal analysis; Minimum Spanning Tree (MST); Object tracking; Linear Assignment Problem (LAP); Kalman filter; Occlusion; MOVING-OBJECTS; VISUAL TRACKING; SEGMENTATION; INTELLIGENCE; CAMERA; DESCRIPTORS; SUBTRACTION; FLUID;
D O I
10.1016/j.jvcir.2018.12.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we propose a novel approach for detecting and tracking objects in videos captured by moving cameras without any additional sensor. In such a video both the background and foreground change in each frame of the image sequence; making the separation of actual moving object from the background a challenging task. In this work, moving objects are detected as clusters of spatio-temporal blobs generated by spatio-temporal analysis of the image sequence using a three-dimensional Gabor filter and merged using Minimum Spanning Tree. Problem of data association during tracking is solved by Linear Assignment Problem and occlusion is handled by the application of Kalman filter. The major advantage of the proposed method is that, it does not require initialization or training on sample data to perform. Our algorithm demonstrated very satisfactory state-of-the-art result on benchmark videos. The performance of the algorithm is equivalent or superior to some benchmark algorithms. (C) 2018 Published by Elsevier Inc.
引用
收藏
页码:662 / 674
页数:13
相关论文
共 50 条
  • [41] Video-based salient object detection via spatio-temporal difference and coherence
    Huang, Lei
    Luo, Bin
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (09) : 10685 - 10699
  • [42] Semantic analysis of action with spatio-temporal features based on object detection
    Chen, Cheng
    Wang, Yang
    Yi, Ke
    Wang, Tongxi
    Xiang, Hua
    [J]. Engineering Letters, 2020, 28 (02): : 616 - 623
  • [43] Semantic Analysis of Action with Spatio-Temporal Features Based on Object Detection
    Chen, Cheng
    Wang, Yang
    Yi, Ke
    Wang, Tongxi
    Xiang, Hua
    [J]. ENGINEERING LETTERS, 2020, 28 (02) : 616 - 623
  • [44] Spatio-Temporal Analysis for Moving Object Detection Under Complex Environment
    Suheryadi, Adi
    Nugroho, Hertog
    [J]. 2016 INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE AND INFORMATION SYSTEMS (ICACSIS), 2016, : 498 - 504
  • [45] Robust spatio-temporal multimodal background subtraction for video surveillance
    Poppe, Chris
    Martens, Gaetan
    De Bruyne, Sarah
    Lambert, Peter
    Van de Walle, Rik
    [J]. OPTICAL ENGINEERING, 2008, 47 (10)
  • [46] Spatio-temporal composition of video objects: Representation and querying in video database systems
    Pissinou, N
    Radev, I
    Makki, K
    Campbell, WJ
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2001, 13 (06) : 1033 - 1040
  • [47] A MULTISCALE SPATIO-TEMPORAL BACKGROUND MODEL FOR MOTION DETECTION
    Lu, Xiqun
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 3268 - 3271
  • [48] Video object segmentation using spatio-temporal deep network
    Ramaswamy, Akshaya
    Gubbi, Jayavardhana
    Balamuralidhar, P.
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [49] Automatic video background replacement using shape-based probabilistic spatio-temporal object segmentation
    Ahmed, Rakib
    Karmakar, Gour C.
    Dooley, Laurence S.
    [J]. 2007 6TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS & SIGNAL PROCESSING, VOLS 1-4, 2007, : 914 - +
  • [50] Spatio-temporal hierarchical feature transformer for UAV object tracking
    Zhu, Fuzhen
    Cui, Jingyi
    Dou, Kaiqi
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 204 : 442 - 452