Convolution operators for visual tracking based on spatial-temporal regularization

被引:9
|
作者
Wang, Peng [1 ,2 ,3 ]
Sun, Mengyu [3 ]
Wang, Haiyan [1 ,4 ]
Li, Xiaoyan [3 ]
Yang, Yongxia [3 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Minist Ind & Informat Technol, Key Lab Ocean Acoust & Sensing, Xian 710072, Shaanxi, Peoples R China
[3] Xian Technol Univ, Sch Elect & Informat Engn, Xian 710021, Shaanxi, Peoples R China
[4] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Shaanxi, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 10期
基金
中国国家自然科学基金;
关键词
Target tracking; Correlation filter; Online PA; Reliability of channel;
D O I
10.1007/s00521-020-04704-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the method based on discriminative correlation filter has been shown excellent performance in short-term visual tracking. However, discriminative correlation filter-based method heavily suffers from the problem of the multiple peaks and model drift in responds maps incurred by occlusion and rotation. To solve the above problem, we proposed convolution operators for visual tracking based on spatial-temporal regularization. Firstly, we add spatial-temporal regularization in loss function, which will guarantee continuity of the model in time. And we use preconditioned conjugate gradient algorithm to obtain filter coefficients. Secondly, we proposed channel reliability to estimate quality of the learned filter and fuse the different reliability coefficients to weight response map in location. We set a threshold to reduce the number of iteration in location and accelerate the compute speed of algorithm. Finally, we use two different correlation filters to estimate location and scale of target, respectively. Extensively experiment in five video sequences show that our tracker has been significantly improved performance in case of occlusion and rotation. The AUC in success plot improves 33.2% than ECO-HC and 41.5% than STRCF, respectively.
引用
收藏
页码:5339 / 5351
页数:13
相关论文
共 50 条
  • [1] Convolution operators for visual tracking based on spatial–temporal regularization
    Peng Wang
    Mengyu Sun
    Haiyan Wang
    Xiaoyan Li
    Yongxia Yang
    Neural Computing and Applications, 2020, 32 : 5339 - 5351
  • [2] An improved spatial-temporal regularization method for visual object tracking
    Hayat, Muhammad Umar
    Ali, Ahmad
    Khan, Baber
    Mehmood, Khizer
    Ullah, Khitab
    Amir, Muhammad
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2065 - 2077
  • [3] Adaptive Spatial-Temporal Regularization for Correlation Filters Based Visual Object Tracking
    Chen, Fei
    Wang, Xiaodong
    SYMMETRY-BASEL, 2021, 13 (09):
  • [4] A Correlation Filter Target Tracking Algorithm Based on Continuous Convolution Operator and Spatial-Temporal Regularization Term
    Li X.
    Sun M.
    Wang P.
    Yang Y.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2019, 37 (06): : 1264 - 1270
  • [5] Toward robust visual tracking for UAV with adaptive spatial-temporal weighted regularization
    Chen, Zhi
    Liu, Lijun
    Yu, Zhen
    VISUAL COMPUTER, 2024, : 8987 - 9003
  • [6] Mining Spatial-Temporal Similarity for Visual Tracking
    Zhang, Yu
    Gao, Xingyu
    Chen, Zhenyu
    Zhong, Huicai
    Xie, Hongtao
    Yan, Chenggang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8107 - 8119
  • [7] Correlation filter tracking algorithm based on spatial-temporal regularization and context awareness
    Wu, Xuedong
    Xu, Jie
    Zhu, Zhiyu
    Wang, Yaonan
    Zhang, Qiang
    Tang, Siming
    Liang, Mengquan
    Cao, Baiheng
    APPLIED INTELLIGENCE, 2022, 52 (15) : 17772 - 17783
  • [8] Correlation filter tracking algorithm based on spatial-temporal regularization and context awareness
    Xuedong Wu
    Jie Xu
    Zhiyu Zhu
    Yaonan Wang
    Qiang Zhang
    Siming Tang
    Mengquan Liang
    Baiheng Cao
    Applied Intelligence, 2022, 52 : 17772 - 17783
  • [9] Learning Dynamic Spatial-Temporal Regularization for UAV Object Tracking
    Deng, Chenwei
    He, Shuangcheng
    Han, Yuqi
    Zhao, Boya
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1230 - 1234
  • [10] Correlation Tracking via Spatial-Temporal Constraints and Structured Sparse Regularization
    Tian, Dan
    Zang, Shouyu
    Tu, Binbin
    IEEE ACCESS, 2021, 9 : 82675 - 82685