Target-Aware Transformer Tracking

被引:5
|
作者
Zheng, Yuhui [1 ,2 ]
Zhang, Yan [1 ]
Xiao, Bin [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Correlation; Target tracking; Prediction algorithms; Filtering algorithms; Neural networks; Object tracking; transformer; target-aware module; classification regression network;
D O I
10.1109/TCSVT.2023.3276061
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object tracking is aimed at locating a specific object in the image sequence, such as pedestrians, vehicles, and so on. The existing algorithms based on siamese neural network predict the target through similarity matching. Although these algorithms have achieved satisfactory performance, in the process of similarity calculation between template image and search image, only local information is often concerned, which makes the algorithms difficult to obtain the optimal solution. To deal with the abovementioned problems, we propose a model based on Transformer, named TaTrack. Specifically, we first use the encoders to enhance the features. Then, the dependency between template features and search features is established through the target-aware module. Finally, we utilize the classification regression network to locate the target, and use the classification score to adapt to update the template image. Experiments show that our model can achieve great performance on GOT-10k, LaSOT, and TrackingNet datasets.
引用
收藏
页码:4542 / 4551
页数:10
相关论文
共 50 条
  • [1] TATrack: Target-aware transformer for object tracking
    Huang, Kai
    Chu, Jun
    Leng, Lu
    Dong, Xingbo
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [2] Target-Aware Transformer for Satellite Video Object Tracking
    Lai, Pujian
    Zhang, Meili
    Cheng, Gong
    Li, Shengyang
    Huang, Xiankai
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [3] Target-aware transformer tracking with hard occlusion instance generation
    Xiao, Dingkun
    Wei, Zhenzhong
    Zhang, Guangjun
    FRONTIERS IN NEUROROBOTICS, 2024, 17
  • [4] Target-Aware Deep Tracking
    Li, Xin
    Ma, Chao
    Wu, Baoyuan
    He, Zhenyu
    Yang, Ming-Hsuan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1369 - 1378
  • [5] Know Who You Are: Learning Target-Aware Transformer for Object Tracking
    Zou, Zhuojun
    Liu, Xuexin
    Zhang, Yuanpei
    Shu, Lin
    Hao, Jie
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1427 - 1432
  • [6] Knowledge Distillation via the Target-aware Transformer
    Lin, Sihao
    Xie, Hongwei
    Wang, Bing
    Yu, Kaicheng
    Chang, Xiaojun
    Liang, Xiaodan
    Wang, Gang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10905 - 10914
  • [7] Target-Aware State Estimation for Visual Tracking
    Zhou, Zikun
    Li, Xin
    Fan, Nana
    Wang, Hongpeng
    He, Zhenyu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 2908 - 2920
  • [8] Learning target-aware correlation filters for visual tracking
    Li, Dongdong
    Wen, Gongjian
    Kuai, Yangliu
    Xiao, Jingjing
    Porikli, Fatih
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 : 149 - 159
  • [9] Structural target-aware model for thermal infrared tracking
    Yuan, Di
    Shu, Xiu
    Liu, Qiao
    He, Zhenyu
    NEUROCOMPUTING, 2022, 491 : 44 - 56
  • [10] Target-Aware Correlation Filter Tracking in RGBD Videos
    Kuai, Yangliu
    Wen, Gongjian
    Li, Dongdong
    Xiao, Jingjing
    IEEE SENSORS JOURNAL, 2019, 19 (20) : 9522 - 9531