Target-Aware Transformer Tracking

被引:5
|
作者
Zheng, Yuhui [1 ,2 ]
Zhang, Yan [1 ]
Xiao, Bin [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Correlation; Target tracking; Prediction algorithms; Filtering algorithms; Neural networks; Object tracking; transformer; target-aware module; classification regression network;
D O I
10.1109/TCSVT.2023.3276061
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object tracking is aimed at locating a specific object in the image sequence, such as pedestrians, vehicles, and so on. The existing algorithms based on siamese neural network predict the target through similarity matching. Although these algorithms have achieved satisfactory performance, in the process of similarity calculation between template image and search image, only local information is often concerned, which makes the algorithms difficult to obtain the optimal solution. To deal with the abovementioned problems, we propose a model based on Transformer, named TaTrack. Specifically, we first use the encoders to enhance the features. Then, the dependency between template features and search features is established through the target-aware module. Finally, we utilize the classification regression network to locate the target, and use the classification score to adapt to update the template image. Experiments show that our model can achieve great performance on GOT-10k, LaSOT, and TrackingNet datasets.
引用
收藏
页码:4542 / 4551
页数:10
相关论文
共 50 条
  • [21] An Interpretable Target-Aware Vision Transformer for Polarimetric HRRP Target Recognition with a Novel Attention Loss
    Gao, Fan
    Lang, Ping
    Yeh, Chunmao
    Li, Zhangfeng
    Ren, Dawei
    Yang, Jian
    REMOTE SENSING, 2024, 16 (17)
  • [22] SiamCA: Siamese visual tracking with customized anchor and target-aware interaction
    Pan, Shuqi
    Zhang, Canlong
    Li, Zhixin
    Hu, Liaojie
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [23] Target-Aware Feature Bottleneck for Real-Time Visual Tracking
    Choi, Janghoon
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [24] Lightweight Target-Aware Attention Learning Network-Based Target Tracking Method
    Zhao, Yanchun
    Zhang, Jiapeng
    Duan, Rui
    Li, Fusheng
    Zhang, Huanlong
    MATHEMATICS, 2022, 10 (13)
  • [25] High-Performance Discriminative Tracking with Target-Aware Feature Embeddings
    Yu, Bin
    Tang, Ming
    Zheng, Linyu
    Zhu, Guibo
    Wang, Jinqiao
    Lu, Hanqing
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, 2021, 13019 : 3 - 15
  • [26] Target-Aware Deep Feature Compression for Power Intelligent Inspection Tracking
    Jiang, Wei
    Guo, Zhimin
    Zhang, Huanlong
    Cheng, Liyun
    Tian, Yangyang
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2022, 2022
  • [27] Focal DETR: Target-Aware Token Design for Transformer-Based Object Detection
    Xie, Tianming
    Zhang, Zhonghao
    Tian, Jing
    Ma, Lihong
    SENSORS, 2022, 22 (22)
  • [28] TAFormer: A Unified Target-Aware Transformer for Video and Motion Joint Prediction in Aerial Scenes
    Xu, Liangyu
    Lu, Wanxuan
    Yu, Hongfeng
    Mao, Yongqiang
    Bi, Hanbo
    Liu, Chenglong
    Sun, Xian
    Fu, Kun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [29] Learning Target-Aware Vision Transformers for Real-Time UAV Tracking
    Li, Shuiwang
    Yang, Xiangyang
    Wang, Xucheng
    Zeng, Dan
    Ye, Hengzhou
    Zhao, Qijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [30] Target-Aware Molecular Graph Generation
    Tan, Cheng
    Gao, Zhangyang
    Li, Stan Z.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE AND DEMO TRACK, ECML PKDD 2023, PT VI, 2023, 14174 : 410 - 427