Improved SwinTrack single target tracking algorithm based on spatio-temporal feature fusion

被引:1
|
作者
Zhao, Min [1 ,2 ]
Yue, Qiang [1 ]
Sun, Dihua [1 ]
Zhong, Yuan [1 ]
机构
[1] Chongqing Univ, Sch Automat, Chongqing, Peoples R China
[2] Chongqing Univ, Sch Automat, Chongqing 400044, Peoples R China
关键词
computer vision; feature extraction; image processing; object tracking;
D O I
10.1049/ipr2.12803
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single target tracking based on computer vision helps to collect, analyse and exploit target information. The SwinTrack algorithm has received widespread attention as one of the twin network algorithms with the best trade-off between tracking accuracy and speed, but it also suffers from the insufficient fusion of deep and shallow features leading to loss of shallow information and insufficient use of temporal information leading to inconsistency between target and template. Semantic information and detailed information are combined and multiple convolutional forms are introduced to propose a multi-level feature fusion strategy to effectively fuse features in space. Besides, based on the idea of feedback, a dynamic template branching approach is also designed to fuse temporal features and enhance the representation of target features. The effectiveness of this method was verified on the OTB100 and GOT10K datasets.
引用
收藏
页码:2410 / 2421
页数:12
相关论文
共 50 条
  • [31] A Robot Ground Medium Classification Algorithm Based on Feature Fusion and Adaptive Spatio-Temporal Cascade Networks
    Feng, Changqun
    Dong, Keming
    Ou, Xinyu
    [J]. NEURAL PROCESSING LETTERS, 2024, 56 (05)
  • [32] Object tracking via Spatio-Temporal Context learning based on multi-feature fusion in stationary scene
    Cheng, Yunfei
    Wang, Wu
    [J]. AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [33] Robust spatio-temporal context for infrared target tracking
    Cui, Zheng
    Yang, Jingli
    Jiang, Shouda
    Li, Junbao
    Gu, Yanfeng
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2018, 91 : 263 - 277
  • [34] A Spatio-Temporal Feature Trajectory Clustering Algorithm Based on Deep Learning
    He, Xintai
    Li, Qing
    Wang, Runze
    Chen, Kun
    [J]. ELECTRONICS, 2022, 11 (15)
  • [35] Dim and Small Target Detection Based on Improved Spatio-Temporal Filtering
    Li Juliu
    Fan Xiangsuo
    Chen Huajin
    Li Bing
    Min Lei
    Xu Zhiyong
    [J]. IEEE PHOTONICS JOURNAL, 2022, 14 (01):
  • [36] Robust Spatio-temporal Context Tracking Algorithm Based on Correlation Filter
    Wan, Hao
    Li, Weiguang
    Cui, Junkuan
    Liu, Quanquan
    Wang, Chunbao
    Duan, Lihong
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SAFETY FOR ROBOTICS (ISR), 2018, : 545 - 550
  • [37] Spatio-temporal graphical-model-based multiple facial feature tracking
    Su, CY
    Huang, L
    [J]. EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (13) : 2091 - 2100
  • [38] Spatio-Temporal Graphical-Model-Based Multiple Facial Feature Tracking
    Congyong Su
    Li Huang
    [J]. EURASIP Journal on Advances in Signal Processing, 2005
  • [39] A TARGET TRACKING ALGORITHM BASED ON ADAPTIVE MULTIPLE FEATURE FUSION
    Yin, Hongpeng
    Chai, Yi
    Yang, Simon X.
    Chiu, David K. Y.
    [J]. ICINCO 2009: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 1: INTELLIGENT CONTROL SYSTEMS AND OPTIMIZATION, 2009, : 5 - +
  • [40] A Target Tracking Algorithm Based on Mean Shift With Feature Fusion
    Ji Xiaoyan
    [J]. 2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 4704 - 4709