Convolution operators for visual tracking based on spatial-temporal regularization

被引:9
|
作者
Wang, Peng [1 ,2 ,3 ]
Sun, Mengyu [3 ]
Wang, Haiyan [1 ,4 ]
Li, Xiaoyan [3 ]
Yang, Yongxia [3 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Minist Ind & Informat Technol, Key Lab Ocean Acoust & Sensing, Xian 710072, Shaanxi, Peoples R China
[3] Xian Technol Univ, Sch Elect & Informat Engn, Xian 710021, Shaanxi, Peoples R China
[4] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Shaanxi, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 10期
基金
中国国家自然科学基金;
关键词
Target tracking; Correlation filter; Online PA; Reliability of channel;
D O I
10.1007/s00521-020-04704-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the method based on discriminative correlation filter has been shown excellent performance in short-term visual tracking. However, discriminative correlation filter-based method heavily suffers from the problem of the multiple peaks and model drift in responds maps incurred by occlusion and rotation. To solve the above problem, we proposed convolution operators for visual tracking based on spatial-temporal regularization. Firstly, we add spatial-temporal regularization in loss function, which will guarantee continuity of the model in time. And we use preconditioned conjugate gradient algorithm to obtain filter coefficients. Secondly, we proposed channel reliability to estimate quality of the learned filter and fuse the different reliability coefficients to weight response map in location. We set a threshold to reduce the number of iteration in location and accelerate the compute speed of algorithm. Finally, we use two different correlation filters to estimate location and scale of target, respectively. Extensively experiment in five video sequences show that our tracker has been significantly improved performance in case of occlusion and rotation. The AUC in success plot improves 33.2% than ECO-HC and 41.5% than STRCF, respectively.
引用
收藏
页码:5339 / 5351
页数:13
相关论文
共 50 条
  • [41] Graph Convolution Based Spatial-Temporal Attention LSTM Model for Flood Forecasting
    Feng, Jun
    Sha, Haichao
    Ding, Yukai
    Yan, Le
    Yu, Zhangheng
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [42] Point target detection based on deep spatial-temporal convolution neural network
    Li Mao
    Lin Zai-Ping
    Fan Jian-Peng
    Sheng Wei-Doug
    Li Jun
    An Wei
    Li Xin-Lei
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2021, 40 (01) : 122 - 132
  • [43] Sign Language Recognition Based on Spatial-Temporal Graph Convolution-Transformer
    Takayama, Natsuki
    Benitez-Garcia, Gibran
    Takahashi, Hiroki
    Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, 2021, 87 (12): : 1028 - 1035
  • [44] Power load forecasting based on spatial-temporal fusion graph convolution network
    Jiang, He
    Dong, Yawei
    Dong, Yao
    Wang, Jianzhou
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2024, 204
  • [45] A traffic flow forecasting method based on hybrid spatial-temporal gated convolution
    Zhang, Ying
    Yang, Songhao
    Wang, Hongchao
    Cheng, Yongqiang
    Wang, Jinyu
    Cao, Liping
    An, Ziying
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, : 1805 - 1817
  • [46] Passenger Demand Forecast Model Based on Deformable Convolution Spatial-temporal Network
    Yu R.-Y.
    Lin F.-Y.
    Gao N.-W.
    Li J.
    Ruan Jian Xue Bao/Journal of Software, 2021, 32 (12): : 3839 - 3851
  • [47] Attention Mechanism Based Spatial-Temporal Graph Convolution Network for Traffic Prediction
    Xiao, Wenjuan
    Wang, Xiaoming
    Journal of Computers (Taiwan), 2024, 35 (04) : 93 - 108
  • [48] Spatial-temporal Data Interpolation Based on Spatial-temporal Kriging Method
    Xu M.-L.
    Xing T.
    Han M.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (08): : 1681 - 1688
  • [49] Spatial-Temporal Context-Aware Tracking
    Han, Yuqi
    Deng, Chenwei
    Zhao, Boya
    Zhao, Baojun
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (03) : 500 - 504
  • [50] Tracking the Evolving Spatial-Temporal Gene Networks
    Gong, Weikang
    Wan, Lin
    IFAC PAPERSONLINE, 2015, 48 (28): : 1365 - 1368