Target-Aware Transformer Tracking

被引:5
|
作者
Zheng, Yuhui [1 ,2 ]
Zhang, Yan [1 ]
Xiao, Bin [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Correlation; Target tracking; Prediction algorithms; Filtering algorithms; Neural networks; Object tracking; transformer; target-aware module; classification regression network;
D O I
10.1109/TCSVT.2023.3276061
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object tracking is aimed at locating a specific object in the image sequence, such as pedestrians, vehicles, and so on. The existing algorithms based on siamese neural network predict the target through similarity matching. Although these algorithms have achieved satisfactory performance, in the process of similarity calculation between template image and search image, only local information is often concerned, which makes the algorithms difficult to obtain the optimal solution. To deal with the abovementioned problems, we propose a model based on Transformer, named TaTrack. Specifically, we first use the encoders to enhance the features. Then, the dependency between template features and search features is established through the target-aware module. Finally, we utilize the classification regression network to locate the target, and use the classification score to adapt to update the template image. Experiments show that our model can achieve great performance on GOT-10k, LaSOT, and TrackingNet datasets.
引用
收藏
页码:4542 / 4551
页数:10
相关论文
共 50 条
  • [41] Target-aware Lattice Rescoring for Dialect Recognition
    Tong, Rong
    Ma, Bin
    Li, Haizhou
    Chng, Eng Siong
    12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 740 - +
  • [42] Target-Aware Language Models for Spoken Language Recognition
    Tong, Rong
    Ma, Bin
    Li, Haizhou
    Chang, Eng Siong
    Lee, Kong-Aik
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 200 - +
  • [43] Target-Aware Implicit Mapping for Agricultural Crop Inspection
    Kelly, Shane
    Riccardi, Alessandro
    Marks, Elias
    Magistri, Federico
    Guadagnino, Tiziano
    Chli, Margarita
    Stachniss, Cyrill
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9608 - 9614
  • [44] Target-Aware Recurrent Attentional Network for Radar HRRP Target Recognition
    Xu, Bin
    Chen, Bo
    Wan, Jinwei
    Liu, Hongwei
    Pn, Lin
    SIGNAL PROCESSING, 2019, 155 : 268 - 280
  • [45] A Target-Aware Fusion Framework for Infrared and Visible Images
    Zhang, Yingmei
    Lee, Hyo Jong
    IEEE ACCESS, 2023, 11 : 33666 - 33681
  • [46] Knowledge Enhanced Target-Aware Stance Detection on Tweets
    Zhang, Xin
    Yuan, Jianhua
    Zhao, Yanyan
    Qin, Bing
    KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE GRAPH EMPOWERS NEW INFRASTRUCTURE CONSTRUCTION, 2021, 1466 : 171 - 184
  • [47] Target-Aware Neural Architecture Search and Deployment for Keyword Spotting
    Busia, Paola
    Deriu, Gianfranco
    Rinelli, Luca
    Chesta, Cristina
    Raffo, Luigi
    Meloni, Paolo
    IEEE ACCESS, 2022, 10 : 40687 - 40700
  • [48] Target-aware and spatial-spectral discriminant feature joint correlation filters for hyperspectral video object tracking
    Tang, Yiming
    Liu, Yufei
    Huang, Hong
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 223
  • [49] Target-Aware Image Denoising for Inverse Monte Carlo Rendering
    Gu, Jeongmin
    Back, Jonghee
    Yoon, Sung-Eui
    Moon, Bochang
    ACM TRANSACTIONS ON GRAPHICS, 2024, 43 (04):
  • [50] Target-aware Bayesian inference via generalized thermodynamic integration
    F. Llorente
    L. Martino
    D. Delgado
    Computational Statistics, 2023, 38 : 2097 - 2119