Deformable attention object tracking network based on cross-correlation

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Yuan, Minrui [1 ,2 ]
Zhang, Tianxin [1 ,2 ]
Wang, Hao [3 ,4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[4] Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian, Peoples R China
关键词
Siamese; Deformable attention module; Dual cross-correlation; Lightweight object tracking network; SIAMESE NETWORKS;
D O I
10.1016/j.jvcir.2023.104039
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity and widespread application of embedded devices, lightweight target tracking networks have emerged as a crucial research direction in the field of computer vision. In this paper, we propose a deformable attention object tracking network based on cross -correlation (DAM-LOTNet), which utilizes the lightweight MobileNetV3 network for efficient feature extraction. Aiming at the problem that lightweight networks cannot better capture target features and morphological changes, deformable attention modules are proposed to generate attention maps along the channel and spatial dimensions. Furthermore, a dual crosscorrelation operation is proposed, aiming at fusing channel information and pixel -level information. Thus, the model obtains a more comprehensive feature representation and a more accurate similarity calculation capability while maintaining a lightweight framework. Finally, a feature enhancement network constructed by depthwise separable convolution was added to the classification and regression branches. The designed DAM-LOTNet has 0.552M parameters and 0.121G FLOPs. On the UAV123 dataset, DAM-LOTNet achieves state-of-the-art performance compared to other lightweight object tracking algorithms. Extensive experiments on visual tracking benchmarks (including VOT2018, VOT2019, OTB100, etc.) have demonstrated that DAMLOTNet has extremely low model FLOPs and parameters compared to common deep learning -based trackers, and is essentially on par with these trackers in terms of performance.
引用
下载
收藏
页数:11
相关论文
共 50 条
  • [1] Siamese Deformable Cross-Correlation Network for Real-Time Visual Tracking
    Zheng, Linyu
    Chen, Yingying
    Tang, Ming
    Wang, Jinqiao
    Lu, Hanqing
    NEUROCOMPUTING, 2020, 401 : 36 - 47
  • [2] Cross-Correlation Fusion Graph Convolution-Based Object Tracking
    Fan, Liuyi
    Chen, Wei
    Jiang, Xiaoyan
    SYMMETRY-BASEL, 2023, 15 (03):
  • [3] Video Object Tracking Method Based on Normalized Cross-correlation Matching
    Wu, Jian
    Yue, Heng-jun
    Cao, Yan-yan
    Cui, Zhi-ming
    PROCEEDINGS OF THE NINTH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS TO BUSINESS, ENGINEERING AND SCIENCE (DCABES 2010), 2010, : 523 - 527
  • [4] SiamLight: lightweight networks for object tracking via attention mechanisms and pixel-level cross-correlation
    Lin, Yu-e
    Li, Mengfan
    Liang, Xingzhu
    Xia, Chenxing
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2023, 20 (02)
  • [5] SiamLight: lightweight networks for object tracking via attention mechanisms and pixel-level cross-correlation
    Yu-e Lin
    Mengfan Li
    Xingzhu Liang
    Chenxing Xia
    Journal of Real-Time Image Processing, 2023, 20
  • [6] Cross-Correlation Based μECoG Waveform Tracking
    Schubert, Thomas
    Trumpis, Michael
    Rivilis, Nicole
    Viventi, Jonathan
    2014 36TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2014, : 3264 - 3267
  • [7] Comparative Analysis of Discrete Subtraction and Cross-Correlation for Subpixel Object Tracking
    Ferrer, Belen
    Tomas, Maria-Baralida
    Wan, Min
    Sheridan, John T.
    Mas, David
    APPLIED SCIENCES-BASEL, 2023, 13 (14):
  • [8] SiamADT: Siamese Attention and Deformable Features Fusion Network for Visual Object Tracking
    Wang, Fasheng
    Cao, Ping
    Wang, Xing
    He, Bing
    Sun, Fuming
    NEURAL PROCESSING LETTERS, 2023, 55 (06) : 7933 - 7950
  • [9] SiamADT: Siamese Attention and Deformable Features Fusion Network for Visual Object Tracking
    Fasheng Wang
    Ping Cao
    Xing Wang
    Bing He
    Fuming Sun
    Neural Processing Letters, 2023, 55 : 7933 - 7950
  • [10] Enhancing visual tracking with multi-scale cross-correlation and progressive attention
    Wang, Qinghui
    Yang, Peng
    Dou, Lei
    Neurocomputing, 2025, 623