Spatial graph attention network-based object tracking with adaptive cosine window

被引:0
|
作者
Fan, Liu-Yi [1 ]
Jiang, Xiao-Yan [1 ]
Huang, Bo [1 ]
Zhang, Juan [1 ]
Gao, Yong-Bin [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
Single object tracking; Graph attention networks; Siamese network; Kalman filter; Attention mask; NEURAL-NETWORK;
D O I
10.1007/s10489-023-04839-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most popular Siamese trackers optimize the classification map from the tracking head using a fixed cosine window penalty. However, this fixed operation, which sets the weight and center of the cosine window to fixed values, can lead to tracking errors when there are similar interferences or the target is out of view. In addition, traditional graph attention networks determine attention weights only based on the cosine similarity between nodes, ignoring the relationship between the positions of nodes in the template and search region. To address these issues, this paper proposes a spatial graph attention network-based object tracking with adaptive cosine window in tracking head. The adaptive cosine window combines spatial-temporal information and adjusts the cosine window, using a positional bias Kalman filter to predict the offset of the target in the search region. The location-based attention mask module considers both the similarity between nodes and their positions in the template and search region, rather than just node similarity, which reduces the impact of similar surroundings. The attention weights between nodes are constrained using a position matrix based on Gaussian functions. Extensive experiments on four challenging public datasets (GOT-10k, UAV123, OTB-100, and LaSOT) show that our tracker outperforms other state-of-the-art trackers.
引用
收藏
页码:26439 / 26453
页数:15
相关论文
共 50 条
  • [1] Spatial graph attention network-based object tracking with adaptive cosine window
    Liu-Yi Fan
    Xiao-Yan Jiang
    Bo Huang
    Juan Zhang
    Yong-Bin Gao
    Applied Intelligence, 2023, 53 : 26439 - 26453
  • [2] Adaptive object tracking based on spatial attention mechanism
    Xie Y.
    Chen Y.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2019, 41 (09): : 1945 - 1954
  • [3] Object tracking based on siamese network with 3D attention and multiple graph attention
    Yan, Shilei
    Qi, Yujuan
    Liu, Mengxue
    Wang, Yanjiang
    Liu, Baodi
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [4] Object tracking based on spatial attention mechanism
    Xie, Yu
    Chen, Ying
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7595 - 7599
  • [5] Channel and spatial attention-based Siamese network for visual object tracking
    Tian, Shishun
    Chen, Zixi
    Chen, Bolin
    Zou, Wenbin
    Li, Xia
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
  • [6] A Multi-Template Fusion Object Tracking Algorithm Based on Graph Attention Network
    Lu, Xiaofeng
    Li, Xiaopeng
    Wang, Zhengyang
    Hei, Xinhong
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2023, 18 (02) : 243 - 253
  • [7] Graph attention network-based fluid simulation model
    Liu, Qiang
    Zhu, Wei
    Ma, Feng
    Jia, Xiyu
    Gao, Yu
    Wen, Jun
    AIP ADVANCES, 2022, 12 (09)
  • [8] Graph Convolution Neural Network-Based Data Association for Online Multi-Object Tracking
    Lee, Jimi
    Jeong, Mira
    Ko, Byoung Chul
    IEEE ACCESS, 2021, 9 : 114535 - 114546
  • [9] Spatial-temporal attention with graph and general neural network-based sign language recognition
    Miah, Abu Saleh Musa
    Hasan, Md. Al Mehedi
    Okuyama, Yuichi
    Tomioka, Yoichi
    Shin, Jungpil
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (02)
  • [10] An adaptive window object tracking algorithm based on variable resolution
    Li, L.
    OPTO-ELECTRONICS REVIEW, 2011, 19 (02) : 219 - 224