Deformable attention object tracking network based on cross-correlation

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Yuan, Minrui [1 ,2 ]
Zhang, Tianxin [1 ,2 ]
Wang, Hao [3 ,4 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[4] Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian, Peoples R China
关键词
Siamese; Deformable attention module; Dual cross-correlation; Lightweight object tracking network; SIAMESE NETWORKS;
D O I
10.1016/j.jvcir.2023.104039
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing popularity and widespread application of embedded devices, lightweight target tracking networks have emerged as a crucial research direction in the field of computer vision. In this paper, we propose a deformable attention object tracking network based on cross -correlation (DAM-LOTNet), which utilizes the lightweight MobileNetV3 network for efficient feature extraction. Aiming at the problem that lightweight networks cannot better capture target features and morphological changes, deformable attention modules are proposed to generate attention maps along the channel and spatial dimensions. Furthermore, a dual crosscorrelation operation is proposed, aiming at fusing channel information and pixel -level information. Thus, the model obtains a more comprehensive feature representation and a more accurate similarity calculation capability while maintaining a lightweight framework. Finally, a feature enhancement network constructed by depthwise separable convolution was added to the classification and regression branches. The designed DAM-LOTNet has 0.552M parameters and 0.121G FLOPs. On the UAV123 dataset, DAM-LOTNet achieves state-of-the-art performance compared to other lightweight object tracking algorithms. Extensive experiments on visual tracking benchmarks (including VOT2018, VOT2019, OTB100, etc.) have demonstrated that DAMLOTNet has extremely low model FLOPs and parameters compared to common deep learning -based trackers, and is essentially on par with these trackers in terms of performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Object Ranging and Sensing by Temporal Cross-correlation Measurement
    Kuniyil, Hashir
    Jam, Naser
    Durak, Kadir
    SPIE FUTURE SENSING TECHNOLOGIES (2020), 2020, 11525
  • [32] Siamese Network Object Tracking Algorithm Combining Attention Mechanism and Correlation Filter Theory
    Hu, Xiuhua
    Liu, Huan
    Chen, Yuan
    Hui, Yan
    Liang, Yingyu
    Wu, Xi
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (01)
  • [33] Cell Tracking by Normalized Cross-Correlation with Image Processing
    Perez-Careta, E.
    Torres-Cisneros, A.
    Debeir, O.
    Sanchez-Mondragon, J.
    Avina-Cervantes, J. G.
    Ibarra-Manzano, O. G.
    May-Arrioja, D.
    Perez-Pantoja, E.
    Negrete-Romero, G.
    2008 DIGEST OF THE LEOS SUMMER TOPICAL MEETINGS, 2008, : 43 - +
  • [34] Residual LSTM Attention Network for Object Tracking
    Kim, Hong-In
    Park, Rae-Hong
    IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (07) : 1029 - 1033
  • [35] Cell Recognition and Tracking Using Nonlinear Cross-Correlation
    Perez-Careta, E.
    Torres-Cisneros, M.
    Avina-Cervantes, J. G.
    Debeir, O.
    Ibarra-Manzano, O. G.
    Aguilera-Gomez, E.
    Perez-Pantoja, E.
    Negrete-Romero, G.
    2008 DIGEST OF THE LEOS SUMMER TOPICAL MEETINGS, 2008, : 45 - +
  • [36] Target Tracking Based on Normalized Cross-Correlation Matching Algorithm and Kalman Predictor
    Ma Yongjie
    Gong Ying
    Chen Min
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (18)
  • [37] Squaring and cross-correlation codeless tracking: analysis and generalisation
    Borio, D.
    IET RADAR SONAR AND NAVIGATION, 2011, 5 (09): : 958 - 969
  • [38] Research on Effect of Cross-correlation on Carrier Tracking Accuracy
    Yang, Yi-kang
    Duan, Cheng-qiang
    2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, : 1722 - 1725
  • [39] Effect of bandwidth in cross-correlation based underwater network size estimation
    Anower, M. S.
    Chowdhury, S. A. H.
    Giti, J. E.
    Haque, M. I.
    2014 INTERNATIONAL CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (ICECE), 2014, : 413 - 416
  • [40] Cross-correlation fault diagnosis in control loop based on Bayesian network
    Zhao, Shunyi
    Liu, Fei
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2010, 40 (SUPPL. 1): : 277 - 281