Deformable attention object tracking network based on cross-correlation

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Yuan, Minrui [1 ,2 ]
Zhang, Tianxin [1 ,2 ]
Wang, Hao [3 ,4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[4] Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian, Peoples R China
关键词
Siamese; Deformable attention module; Dual cross-correlation; Lightweight object tracking network; SIAMESE NETWORKS;
D O I
10.1016/j.jvcir.2023.104039
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity and widespread application of embedded devices, lightweight target tracking networks have emerged as a crucial research direction in the field of computer vision. In this paper, we propose a deformable attention object tracking network based on cross -correlation (DAM-LOTNet), which utilizes the lightweight MobileNetV3 network for efficient feature extraction. Aiming at the problem that lightweight networks cannot better capture target features and morphological changes, deformable attention modules are proposed to generate attention maps along the channel and spatial dimensions. Furthermore, a dual crosscorrelation operation is proposed, aiming at fusing channel information and pixel -level information. Thus, the model obtains a more comprehensive feature representation and a more accurate similarity calculation capability while maintaining a lightweight framework. Finally, a feature enhancement network constructed by depthwise separable convolution was added to the classification and regression branches. The designed DAM-LOTNet has 0.552M parameters and 0.121G FLOPs. On the UAV123 dataset, DAM-LOTNet achieves state-of-the-art performance compared to other lightweight object tracking algorithms. Extensive experiments on visual tracking benchmarks (including VOT2018, VOT2019, OTB100, etc.) have demonstrated that DAMLOTNet has extremely low model FLOPs and parameters compared to common deep learning -based trackers, and is essentially on par with these trackers in terms of performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] CROSS-CORRELATION NEURAL-NETWORK MODELS
    DIAMANTARAS, KI
    KUNG, SY
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1994, 42 (11) : 3218 - 3223
  • [42] CROSS-CORRELATION FUNCTION OF A BANDPASS NONLINEAR NETWORK
    DEBOER, E
    PROCEEDINGS OF THE IEEE, 1976, 64 (09) : 1443 - 1444
  • [43] Synergetic neural network with cross-correlation dynamics
    Kitahara, Jun
    Nakagawa, Masahiro
    Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi), 1998, 81 (09): : 37 - 47
  • [44] A synergetic neural network with cross-correlation dynamics
    Kitahara, J
    Nakagawa, M
    ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 1998, 81 (09): : 37 - 47
  • [45] Multi-level Cross-attention Siamese Network For Visual Object Tracking
    Zhang, Jianwei
    Wang, Jingchao
    Zhang, Huanlong
    Miao, Mengen
    Cai, Zengyu
    Chen, Fuguo
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (12): : 3976 - 3990
  • [46] Cross-correlation and cross-tracking of compressed digital PIV images
    Gray, C
    OPTICAL TECHNOLOGY IN FLUID, THERMAL, AND COMBUSTION FLOW III, 1997, 3172 : 153 - 164
  • [47] Object Tracking Based on Visual Attention
    Lin, Mingqiang
    Dai, Houde
    2016 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (ICIA), 2016, : 1846 - 1849
  • [48] Object Tracking Based on Channel Attention
    He, Zhiquan
    Chen, Xuejun
    IEEE ACCESS, 2020, 8 : 17824 - 17832
  • [49] Object tracking based on siamese network with 3D attention and multiple graph attention
    Yan, Shilei
    Qi, Yujuan
    Liu, Mengxue
    Wang, Yanjiang
    Liu, Baodi
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [50] HEALPix Based Cross-Correlation in Astronomy
    Fernique, Pierre
    Durand, Daniel
    Boch, Thomas
    Oberto, Anais
    Pineau, Francois-Xavier
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXII, 2013, 475 : 135 - +