Learning spatio-temporal correlation filter for visual tracking

被引:19
|
作者
Yan, Youmin [1 ]
Guo, Xixian [1 ]
Tang, Jin [1 ]
Li, Chenglong [1 ,4 ]
Wang, Xin [2 ,3 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[2] Peking Univ, Shenzhen Grad Sch, Shenzhen 518055, Peoples R China
[3] Shenzhen Raixun Informat Technol Co Ltd, Shenzhen, Peoples R China
[4] Anhui Univ, Inst Phys Sci & Informat Technol, Hefei 230601, Peoples R China
基金
中国国家自然科学基金;
关键词
Correlation filter; Temporal feature; Spatial feature; Visual tracking;
D O I
10.1016/j.neucom.2021.01.057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Correlation filter (CF) trackers have performed impressive performance with high frame rates. However, the limited information in both spatial and temporal domains is only used in the learning of correlation filters, which might limit the tracking performance. To handle this problem, we propose a novel spatiotemporal correlation filter approach, which employs both spatial and temporal cues in the learning, for visual tracking. In particular, we explore the spatial contexts from background whose contents are ambiguous to the target and integrate them into the correlation filter model for more discriminative learning. Moreover, to capture the appearance variations in temporal domain, we also compute a set of target templates and incorporate them into our model. At the same time, the solution of the proposed spatio-temporal correlation filter is closed-form and the tracking efficiency is thus guaranteed. Experimental experiments on benchmark datasets demonstrate the effectiveness of the proposed tracker against several CF ones. (c) 2021 Elsevier B.V. All rights reserved. Correlation filter (CF) trackers have performed impressive performance with high frame rates. However, the limited information in both spatial and temporal domains is only used in the learning of correlation filters, which might limit the tracking performance. To handle this problem, we propose a novel spatiotemporal correlation filter approach, which employs both spatial and temporal cues in the learning, for visual tracking. In particular, we explore the spatial contexts from background whose contents are ambiguous to the target and integrate them into the correlation filter model for more discriminative learning. Moreover, to capture the appearance variations in temporal domain, we also compute a set of target templates and incorporate them into our model. At the same time, the solution of the proposed spatio-temporal correlation filter is closed-form and the tracking efficiency is thus guaranteed. Experimental experiments on benchmark datasets demonstrate the effectiveness of the proposed tracker against several CF ones.
引用
收藏
页码:273 / 282
页数:10
相关论文
共 50 条
  • [1] Spatio-temporal joint aberrance suppressed correlation filter for visual tracking
    Libin Xu
    Pyoungwon Kim
    Mengjie Wang
    Jinfeng Pan
    Xiaomin Yang
    Mingliang Gao
    Complex & Intelligent Systems, 2022, 8 : 3765 - 3777
  • [2] Spatio-temporal joint aberrance suppressed correlation filter for visual tracking
    Xu, Libin
    Kim, Pyoungwon
    Wang, Mengjie
    Pan, Jinfeng
    Yang, Xiaomin
    Gao, Mingliang
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (05) : 3765 - 3777
  • [3] Spatio-temporal Active Learning for Visual Tracking
    Liu, Chenfeng
    Zhu, Pengfei
    Hu, Qinghua
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [4] Learning Spatio-Temporal Transformer for Visual Tracking
    Yan, Bin
    Peng, Houwen
    Fu, Jianlong
    Wang, Dong
    Lu, Huchuan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10428 - 10437
  • [5] Deep learning of spatio-temporal information for visual tracking
    Gwangmin Choe
    Ilmyong Son
    Chunhwa Choe
    Hyoson So
    Hyokchol Kim
    Gyongnam Choe
    Multimedia Tools and Applications, 2022, 81 : 17283 - 17302
  • [6] Deep learning of spatio-temporal information for visual tracking
    Choe, Gwangmin
    Son, Ilmyong
    Choe, Chunhwa
    So, Hyoson
    Kim, Hyokchol
    Choe, Gyongnam
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (12) : 17283 - 17302
  • [7] Adaptive spatio-temporal context learning for visual tracking
    Zhang, Yaqin
    Wang, Liejun
    Qin, Jiwei
    IMAGING SCIENCE JOURNAL, 2019, 67 (03): : 136 - 147
  • [8] Spatio-Temporal Discriminative Correlation Filter Based Object Tracking
    Xu, Zheng
    Zhu, Songhao
    Sun, Peng
    Guo, Wenbo
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 5284 - 5288
  • [9] SPATIO-TEMPORAL CORRELATION LEARNING FOR MULTIPLE OBJECT TRACKING
    Jian, Yajun
    Zhuang, Chihui
    He, Wenyan
    Du, Kaiwen
    Lu, Yang
    Wang, Hanzi
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6170 - 6174
  • [10] Spatio-Temporal Context, Correlation Filter and Measurement Estimation Collaboration Based Visual Object Tracking
    Mehmood, Khizer
    Jalil, Abdul
    Ali, Ahmad
    Khan, Baber
    Murad, Maria
    Cheema, Khalid Mehmood
    Milyani, Ahmad H.
    SENSORS, 2021, 21 (08)