Learning spatio-temporal correlation filter for visual tracking

被引:19
|
作者
Yan, Youmin [1 ]
Guo, Xixian [1 ]
Tang, Jin [1 ]
Li, Chenglong [1 ,4 ]
Wang, Xin [2 ,3 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[2] Peking Univ, Shenzhen Grad Sch, Shenzhen 518055, Peoples R China
[3] Shenzhen Raixun Informat Technol Co Ltd, Shenzhen, Peoples R China
[4] Anhui Univ, Inst Phys Sci & Informat Technol, Hefei 230601, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation filter; Temporal feature; Spatial feature; Visual tracking;
D O I
10.1016/j.neucom.2021.01.057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Correlation filter (CF) trackers have performed impressive performance with high frame rates. However, the limited information in both spatial and temporal domains is only used in the learning of correlation filters, which might limit the tracking performance. To handle this problem, we propose a novel spatiotemporal correlation filter approach, which employs both spatial and temporal cues in the learning, for visual tracking. In particular, we explore the spatial contexts from background whose contents are ambiguous to the target and integrate them into the correlation filter model for more discriminative learning. Moreover, to capture the appearance variations in temporal domain, we also compute a set of target templates and incorporate them into our model. At the same time, the solution of the proposed spatio-temporal correlation filter is closed-form and the tracking efficiency is thus guaranteed. Experimental experiments on benchmark datasets demonstrate the effectiveness of the proposed tracker against several CF ones. (c) 2021 Elsevier B.V. All rights reserved. Correlation filter (CF) trackers have performed impressive performance with high frame rates. However, the limited information in both spatial and temporal domains is only used in the learning of correlation filters, which might limit the tracking performance. To handle this problem, we propose a novel spatiotemporal correlation filter approach, which employs both spatial and temporal cues in the learning, for visual tracking. In particular, we explore the spatial contexts from background whose contents are ambiguous to the target and integrate them into the correlation filter model for more discriminative learning. Moreover, to capture the appearance variations in temporal domain, we also compute a set of target templates and incorporate them into our model. At the same time, the solution of the proposed spatio-temporal correlation filter is closed-form and the tracking efficiency is thus guaranteed. Experimental experiments on benchmark datasets demonstrate the effectiveness of the proposed tracker against several CF ones.
引用
收藏
页码:273 / 282
页数:10
相关论文
共 50 条
  • [31] STRUCTURAL SPATIO-TEMPORAL TRANSFORM FOR ROBUST VISUAL TRACKING
    Tang, Yazhe
    Lao, Mingjie
    Lin, Feng
    Wu, Denglu
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1105 - 1109
  • [32] Learning spatio-temporal properties of visual cells
    Burkitt, Anthony
    Lian, Yanbo
    Ruslim, Marko
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S116 - S116
  • [33] Extremum Tracking in Sensor Fields with Spatio-temporal Correlation
    Basu, Prithwish
    Nadamani, Abhishek
    Tong, Lang
    MILITARY COMMUNICATIONS CONFERENCE, 2010 (MILCOM 2010), 2010, : 1050 - 1055
  • [34] Learning spatio-temporal properties of visual cells
    Burkitt, Anthony
    Lian, Yanbo
    Ruslim, Marko
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S116 - S116
  • [35] LEARNING SPATIAL-TEMPORAL CONSISTENT CORRELATION FILTER FOR VISUAL TRACKING
    Lou, Han
    Wang, Dongfei
    Jiang, Zhuqing
    Men, Aidong
    Zhou, Yun
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2017,
  • [36] Oversaturated part-based visual tracking via spatio-temporal context learning
    Liu, Wei
    Li, Jicheng
    Shi, Zhiguang
    Chen, Xiaotian
    Chen, Xiao
    APPLIED OPTICS, 2016, 55 (25) : 6960 - 6968
  • [37] Memory Network With Pixel-Level Spatio-Temporal Learning for Visual Object Tracking
    Zhou, Zechu
    Zhou, Xinyu
    Chen, Zhaoyu
    Guo, Pinxue
    Liu, Qian-Yu
    Zhang, Wenqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6897 - 6911
  • [38] Tracking Algorithm of Improved Spatio-Temporal Context with Particle Filter
    Wen, Wu
    Wu, Lizhi
    PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2017, : 1549 - 1553
  • [39] Learning spatio-temporal discriminative model for affine subspace based visual object tracking
    Tianyang Xu
    Xue-Feng Zhu
    Xiao-Jun Wu
    Visual Intelligence, 1 (1):
  • [40] Visual Tracking via Spatio-temporal Context Learning using Multi-Templates
    Zhu, Zhengyu
    Zhu, Wei
    Li, Shuai
    2017 IEEE 3RD INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC), 2017, : 708 - 712