Improved SwinTrack single target tracking algorithm based on spatio-temporal feature fusion

被引:1
|
作者
Zhao, Min [1 ,2 ]
Yue, Qiang [1 ]
Sun, Dihua [1 ]
Zhong, Yuan [1 ]
机构
[1] Chongqing Univ, Sch Automat, Chongqing, Peoples R China
[2] Chongqing Univ, Sch Automat, Chongqing 400044, Peoples R China
关键词
computer vision; feature extraction; image processing; object tracking;
D O I
10.1049/ipr2.12803
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single target tracking based on computer vision helps to collect, analyse and exploit target information. The SwinTrack algorithm has received widespread attention as one of the twin network algorithms with the best trade-off between tracking accuracy and speed, but it also suffers from the insufficient fusion of deep and shallow features leading to loss of shallow information and insufficient use of temporal information leading to inconsistency between target and template. Semantic information and detailed information are combined and multiple convolutional forms are introduced to propose a multi-level feature fusion strategy to effectively fuse features in space. Besides, based on the idea of feedback, a dynamic template branching approach is also designed to fuse temporal features and enhance the representation of target features. The effectiveness of this method was verified on the OTB100 and GOT10K datasets.
引用
收藏
页码:2410 / 2421
页数:12
相关论文
共 50 条
  • [1] Improved Spatio-temporal Context Target Tracking Algorithm
    Shi, Yuanhang
    Zang, Junwei
    Liu, Yuhuai
    [J]. PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, INFORMATION AND MECHANICAL ENGINEERING (EMIM 2017), 2017, 76 : 185 - 189
  • [2] Improved Target Tracking Based on Spatio-Temporal Learning
    Jia, Songmin
    Zeng, Dishi
    Xu, Tao
    Zhang, Hui
    Li, Xiuzhi
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 1840 - 1845
  • [3] An improved target tracking algorithm based on spatio-temporal context under occlusions
    Yang, Xin
    Zhu, Songyan
    Zhou, Dake
    Zhang, Yifan
    [J]. MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2020, 31 (01) : 329 - 344
  • [4] An improved target tracking algorithm based on spatio-temporal context under occlusions
    Xin Yang
    Songyan Zhu
    Dake Zhou
    Yifan Zhang
    [J]. Multidimensional Systems and Signal Processing, 2020, 31 : 329 - 344
  • [5] Research on Target Tracking Algorithm Based on Spatio-Temporal Context
    Li, Baiping
    Xu, Sanmei
    Kang, Hongjuan
    [J]. NINTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2017), 2017, 10420
  • [6] An Improved Spatio-temporal Context Tracking Algorithm
    Wan, Hao
    Li, Weiguang
    Ye, Guoqiang
    [J]. PROCEEDINGS OF THE 2018 13TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2018), 2018, : 1320 - 1325
  • [7] Infrared Dim Target Detecting Algorithm Based On Multi-feature And Spatio-temporal Fusion
    Mei, Bai
    Jian, Zhang
    Hui, Zhao
    [J]. SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [8] Multiple Extended Target Tracking Algorithm Based on Spatio-Temporal Correlation
    Zhang, Wei
    Lin, Chen
    Liu, Tingting
    Gan, Lu
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (06):
  • [9] ViT Spatio-Temporal Feature Fusion for Aerial Object Tracking
    Guo, Chuangye
    Liu, Kang
    Deng, Donghu
    Li, Xuelong
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (08) : 6749 - 6761
  • [10] Correlation Filtering Target Tracking Algorithm Based on Nonlinear Spatio-Temporal Regularization
    Jiang, Wentao
    Wang, Deqiang
    Zhang, Shengchong
    [J]. Computer Engineering and Applications, 2024, 60 (03) : 165 - 176