Convolution operators for visual tracking based on spatial-temporal regularization

被引:9
|
作者
Wang, Peng [1 ,2 ,3 ]
Sun, Mengyu [3 ]
Wang, Haiyan [1 ,4 ]
Li, Xiaoyan [3 ]
Yang, Yongxia [3 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Minist Ind & Informat Technol, Key Lab Ocean Acoust & Sensing, Xian 710072, Shaanxi, Peoples R China
[3] Xian Technol Univ, Sch Elect & Informat Engn, Xian 710021, Shaanxi, Peoples R China
[4] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Shaanxi, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 10期
基金
中国国家自然科学基金;
关键词
Target tracking; Correlation filter; Online PA; Reliability of channel;
D O I
10.1007/s00521-020-04704-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the method based on discriminative correlation filter has been shown excellent performance in short-term visual tracking. However, discriminative correlation filter-based method heavily suffers from the problem of the multiple peaks and model drift in responds maps incurred by occlusion and rotation. To solve the above problem, we proposed convolution operators for visual tracking based on spatial-temporal regularization. Firstly, we add spatial-temporal regularization in loss function, which will guarantee continuity of the model in time. And we use preconditioned conjugate gradient algorithm to obtain filter coefficients. Secondly, we proposed channel reliability to estimate quality of the learned filter and fuse the different reliability coefficients to weight response map in location. We set a threshold to reduce the number of iteration in location and accelerate the compute speed of algorithm. Finally, we use two different correlation filters to estimate location and scale of target, respectively. Extensively experiment in five video sequences show that our tracker has been significantly improved performance in case of occlusion and rotation. The AUC in success plot improves 33.2% than ECO-HC and 41.5% than STRCF, respectively.
引用
收藏
页码:5339 / 5351
页数:13
相关论文
共 50 条
  • [21] Gaze Tracking Based on Concatenating Spatial-Temporal Features
    Hwang, Bor-Jiunn
    Chen, Hui-Hui
    Hsieh, Chaur-Heh
    Huang, Deng-Yu
    SENSORS, 2022, 22 (02)
  • [22] Multihuman Tracking Based on a Spatial-Temporal Appearance Match
    Shen, Yuan
    Miao, Zhenjiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (03) : 361 - 373
  • [23] Visual object tracking by using ranking loss and spatial-temporal features
    Saribas, Hasan
    Cevikalp, Hakan
    Kahvecioglu, Sinem
    MACHINE VISION AND APPLICATIONS, 2023, 34 (02)
  • [24] Augmenting cascaded correlation filters with spatial-temporal saliency for visual tracking
    Zhao, Dawei
    Xiao, Liang
    Fu, Hao
    Wu, Tao
    Xu, Xin
    Dai, Bin
    INFORMATION SCIENCES, 2019, 470 : 78 - 93
  • [25] Dynamic memory network with spatial-temporal feature fusion for visual tracking
    Zhang, Hongchao
    Bao, Hua
    Lu, Yixiang
    Zhang, Dexiang
    Xun, Lina
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (05)
  • [26] Modeling of Multiple Spatial-Temporal Relations for Robust Visual Object Tracking
    Wang, Shilei
    Wang, Zhenhua
    Sun, Qianqian
    Cheng, Gong
    Ning, Jifeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 5073 - 5085
  • [27] Second-Order Spatial-Temporal Correlation Filters for Visual Tracking
    Yu, Yufeng
    Chen, Long
    He, Haoyang
    Liu, Jianhui
    Zhang, Weipeng
    Xu, Guoxia
    MATHEMATICS, 2022, 10 (05)
  • [28] Spatial-temporal adaptive feature weighted correlation filter for visual tracking
    Du, Fei
    Liu, Peng
    Zhao, Wei
    Tang, Xianglong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 67 : 58 - 70
  • [29] Visual Tracking using Spatial-Temporal Regularized Support Correlation Filters
    Li, Binshan
    Liu, Chaorong
    Liu, Jie
    Gao, Huiling
    Song, Xuhui
    Liu, Weirong
    2018 3RD INTERNATIONAL CONFERENCE ON COMMUNICATION, IMAGE AND SIGNAL PROCESSING, 2019, 1169
  • [30] Learning adaptive spatial-temporal regularized correlation filters for visual tracking
    Zhao, Jianwei
    Li, Yangxiao
    Zhou, Zhenghua
    IET IMAGE PROCESSING, 2021, 15 (08) : 1773 - 1785