CorrFormer: Context-aware tracking with cross-correlation and transformer

被引:14
|
作者
Zhang, Jianming [1 ,2 ]
He, Yufan [1 ]
Chen, Wentao [1 ]
Kuang, Li -Dan [1 ]
Zheng, Bin
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[2] Changsha Univ Sci & Technol, Key Lab Safety Control Bridge Engn, Minist Educ, Changsha 410114, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; Cross-correlation; Transformer; Decoupled head;
D O I
10.1016/j.compeleceng.2024.109075
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The fusion of the template and search region features plays a significant role in deep learningbased trackers. In Siamese -based trackers, different cross -correlation operations are commonly used to fuse features, which cannot obtain global connections. On the other hand, transformerbased trackers use attention mechanism to fuse features, which cannot suppress the interference of distractors in the background. Furthermore, existing trackers use regression and classification heads with the same structure, which leads to lack a deeper understanding of these two different tasks. To address these problems, we firstly propose a feature enhancement -fusion network (FEFN) based on cross -correlation and transformer, with two Encoders that employ self -attention and a Decoder that removes cross -attention to adapt to the tracking task. Using the FEFN to combine the advantages of Siamese -based and transformer -based trackers, our tracker establishes global connections while effectively suppressing the distractors. We also propose a novel decoupled head, designing a spatial sensitive classification head and a global information sensitive regression head, which helps the context -aware tracker locate the target more accurately. Our proposed tracker obtains 0.710 of AO, 0.814 of SR0.5 and 0.657 of SR0.75 on the GOT -10k test set, and achieves real-time requirement at 36.99FPS.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Context-Aware Correlation Filter Tracking
    Mueller, Matthias
    Smith, Neil
    Ghanem, Bernard
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1387 - 1395
  • [2] Improved Context-Aware Correlation Filter Tracking
    Wang, Nanyang
    Xie, Zhihong
    Huang, Nan
    [J]. 2018 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2018, 10836
  • [3] Adaptive context-aware correlation filter tracking
    Liu Bo
    Xu Ting-fa
    Li Xiang min
    Shi Guo kai
    Huang Bo
    [J]. CHINESE OPTICS, 2019, 12 (02): : 265 - 273
  • [4] Adaptive Context-Aware Correlation Filter Tracking
    Jiang Wentao
    Tu Chao
    Liu Wanjun
    Jin Yan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (24)
  • [5] Adjustable Context-Aware Transformer
    Koohfar, Sepideh
    Dietz, Laura
    [J]. ADVANCED ANALYTICS AND LEARNING ON TEMPORAL DATA, AALTD 2022, 2023, 13812 : 3 - 17
  • [6] Adaptive Context-Aware and Structural Correlation Filter for Visual Tracking
    Zhou, Bin
    Wang, Tuo
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (07):
  • [7] Algorithm for tracking adaptive context-aware correlation filter targets
    Sun Y.
    Xiao S.
    Qu J.
    Dong W.
    [J]. Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2022, 49 (03): : 21 - 27
  • [8] Visual Tracking via Adaptive Context-Aware Correlation Filter
    Liu, Peng
    Wang, Feng
    Liu, Ming
    Ming, Delie
    [J]. PROCEEDINGS OF 2020 IEEE 4TH INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2020), 2020, : 1380 - 1384
  • [9] Hierarchical Spatiotemporal Context-Aware Correlation Filters for Visual Tracking
    Wang, Wuwei
    Zhang, Ke
    Lv, Meibo
    Wang, Jingyu
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (12) : 6066 - 6079
  • [10] Dual Feature Fusion Tracking With Combined Cross-Correlation and Transformer
    Che, Chao
    Fu, Yanyun
    Shi, Wenxi
    Zhu, Zhansheng
    Wang, Deyong
    [J]. IEEE ACCESS, 2023, 11 : 144966 - 144977