Target-Aware Transformer Tracking

被引:5
|
作者
Zheng, Yuhui [1 ,2 ]
Zhang, Yan [1 ]
Xiao, Bin [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Correlation; Target tracking; Prediction algorithms; Filtering algorithms; Neural networks; Object tracking; transformer; target-aware module; classification regression network;
D O I
10.1109/TCSVT.2023.3276061
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object tracking is aimed at locating a specific object in the image sequence, such as pedestrians, vehicles, and so on. The existing algorithms based on siamese neural network predict the target through similarity matching. Although these algorithms have achieved satisfactory performance, in the process of similarity calculation between template image and search image, only local information is often concerned, which makes the algorithms difficult to obtain the optimal solution. To deal with the abovementioned problems, we propose a model based on Transformer, named TaTrack. Specifically, we first use the encoders to enhance the features. Then, the dependency between template features and search features is established through the target-aware module. Finally, we utilize the classification regression network to locate the target, and use the classification score to adapt to update the template image. Experiments show that our model can achieve great performance on GOT-10k, LaSOT, and TrackingNet datasets.
引用
收藏
页码:4542 / 4551
页数:10
相关论文
共 50 条
  • [31] ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Tracking
    Kou, Yutong
    Gao, Jin
    Li, Bing
    Wang, Gang
    Hu, Weiming
    Wang, Yizheng
    Li, Liang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [32] TARGET-AWARE ANOMALY DETECTION AND DIAGNOSIS
    Borisov, Alexander
    Runger, George
    Tuv, Eugene
    ICINCO 2011: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 1, 2011, : 14 - 23
  • [33] TEFNet: Target-Aware Enhanced Fusion Network for RGB-T Tracking
    Chen, Panfeng
    Gong, Shengrong
    Ying, Wenhao
    Du, Xin
    Zhong, Shan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 432 - 443
  • [34] Deep Meta Learning for Real-Time Target-Aware Visual Tracking
    Choi, Janghoon
    Kwon, Junseok
    Lee, Kyoung Mu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 911 - 920
  • [35] SiamATA: an asymmetric target-aware and frequency domain task-aware Siamese network for visual tracking
    Liang, Xingzhu
    Xiao, Yunzhuang
    Lin, Yu-e
    Yan, Xinyun
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [36] Tracking by Joint Local and Global Search: A Target-Aware Attention-Based Approach
    Wang, Xiao
    Tang, Jin
    Luo, Bin
    Wang, Yaowei
    Tian, Yonghong
    Wu, Feng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6931 - 6945
  • [37] Target-Aware Fusion of Infrared and Visible Images
    Zhou, Yingjie
    Gao, Kun
    Dou, Zeyang
    Hua, Zizheng
    Wang, Hong
    IEEE ACCESS, 2018, 6 : 79039 - 79049
  • [38] Target-Aware Data Augmentation for Stance Detection
    Li, Yingjie
    Caragea, Cornelia
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 1850 - 1860
  • [39] CRAXfuzz: Target-Aware Symbolic Fuzz Testing
    Yeh, Chao-Chun
    Chung, Hsiang
    Huang, Shih-Kun
    39TH ANNUAL IEEE COMPUTERS, SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC 2015), VOL 2, 2015, : 460 - 471
  • [40] Target-aware for Few-shot Segmentation
    Luo, XiaoLiu
    Zhang, Taiping
    Duan, Zhao
    Tan, Jin
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,