Deformable attention object tracking network based on cross-correlation

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Yuan, Minrui [1 ,2 ]
Zhang, Tianxin [1 ,2 ]
Wang, Hao [3 ,4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[4] Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian, Peoples R China
关键词
Siamese; Deformable attention module; Dual cross-correlation; Lightweight object tracking network; SIAMESE NETWORKS;
D O I
10.1016/j.jvcir.2023.104039
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity and widespread application of embedded devices, lightweight target tracking networks have emerged as a crucial research direction in the field of computer vision. In this paper, we propose a deformable attention object tracking network based on cross -correlation (DAM-LOTNet), which utilizes the lightweight MobileNetV3 network for efficient feature extraction. Aiming at the problem that lightweight networks cannot better capture target features and morphological changes, deformable attention modules are proposed to generate attention maps along the channel and spatial dimensions. Furthermore, a dual crosscorrelation operation is proposed, aiming at fusing channel information and pixel -level information. Thus, the model obtains a more comprehensive feature representation and a more accurate similarity calculation capability while maintaining a lightweight framework. Finally, a feature enhancement network constructed by depthwise separable convolution was added to the classification and regression branches. The designed DAM-LOTNet has 0.552M parameters and 0.121G FLOPs. On the UAV123 dataset, DAM-LOTNet achieves state-of-the-art performance compared to other lightweight object tracking algorithms. Extensive experiments on visual tracking benchmarks (including VOT2018, VOT2019, OTB100, etc.) have demonstrated that DAMLOTNet has extremely low model FLOPs and parameters compared to common deep learning -based trackers, and is essentially on par with these trackers in terms of performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Position Attention Network for Object Tracking
    Du, Mingzhong
    Wei, Longsheng
    Liu, Shiyu
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6374 - 6379
  • [22] Hyperspectral Attention Network for Object Tracking
    Yu, Shuangjiang
    Ni, Jianjun
    Fu, Shuai
    Qu, Tao
    SENSORS, 2024, 24 (19)
  • [23] Triplet Network Based on Dynamic Feature Attention for Object Tracking
    Zhang Zishuo
    Song Yong
    Yang Xin
    Zhao Yufei
    Zhou Ya
    ACTA OPTICA SINICA, 2022, 42 (15)
  • [24] Object tracking algorithm based on siamese network with combined attention
    Yang M.
    Jia X.
    Yin H.
    Sun F.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2021, 42 (01): : 127 - 136
  • [25] CROSS-CORRELATION FUNCTION OF A NONLINEAR NETWORK
    RUDKO, M
    PROCEEDINGS OF THE IEEE, 1977, 65 (11) : 1615 - 1616
  • [26] CROSS-CORRELATION AND TRACKING FOR THE MEASUREMENT OF PARTICLE VELOCITIES
    TATTERSON, GB
    HEIBEL, JT
    BRODKEY, RS
    INDUSTRIAL & ENGINEERING CHEMISTRY FUNDAMENTALS, 1980, 19 (02): : 175 - 180
  • [27] The Identification and Tracking of Uterine Contractions Using Template Based Cross-Correlation
    Sarah C. McDonald
    Graham Brooker
    Hala Phipps
    Jon Hyett
    Annals of Biomedical Engineering, 2017, 45 : 2196 - 2210
  • [28] INTERMEDIATE DEFORMABLE IMAGE REGISTRATION VIA WINDOWED CROSS-CORRELATION
    Aganj, Iman
    Fischl, Bruce
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [29] The Identification and Tracking of Uterine Contractions Using Template Based Cross-Correlation
    McDonald, Sarah C.
    Brooker, Graham
    Phipps, Hala
    Hyett, Jon
    ANNALS OF BIOMEDICAL ENGINEERING, 2017, 45 (09) : 2196 - 2210
  • [30] AUTO-CORRELATION AND CROSS-CORRELATION ANALYSES OF TRACKING BEHAVIOR
    BENNETT, WF
    AMERICAN PSYCHOLOGIST, 1957, 12 (04) : 451 - 451