Fast and Accurate Visual Tracking with Group Convolution and Pixel-Level Correlation

被引:1
|
作者
Liu, Liduo [1 ,2 ]
Long, Yongji [1 ,2 ]
Li, Guoning [1 ]
Nie, Ting [1 ]
Zhang, Chengcheng [1 ,2 ]
He, Bin [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 17期
基金
美国国家科学基金会;
关键词
feature fusion; pixel-level correlation; Siamese network; attention mechanism; ROBUST;
D O I
10.3390/app13179746
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Visual object trackers based on Siamese networks perform well in visual object tracking (VOT); however, degradation of the tracking accuracy occurs when the target has fast motion, large-scale changes, and occlusion. In this study, in order to solve this problem and enhance the inference speed of the tracker, fast and accurate visual tracking with a group convolution and pixel-level correlation based on a Siamese network is proposed. The algorithm incorporates multi-layer feature information on the basis of Siamese networks. We designed a multi-scale feature aggregated channel attention block (MCA) and a global-to-local-information-fused spatial attention block (GSA), which enhance the feature extraction capability of the network. The use of a pixel-level mutual correlation operation in the network to match the search region with the template region refines the bounding box and reduces background interference. Comparing our work with the latest algorithms, the precision and success rates on the UAV123, OTB100, LaSOT, and GOT10K datasets were improved, and our tracker was able to run at 40FPS, with a better performance in complex scenes such as those with occlusion, illumination changes, and fast-motion situations.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Aneurysmal wall enhancement and hemodynamics: pixel-level correlation between spatial distribution
    Fu, Mingzhu
    Peng, Fei
    Zhang, Miaoqi
    Chen, Shuo
    Niu, Hao
    He, Xiaoxin
    Xu, Boya
    Liu, Aihua
    Li, Rui
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2022, 12 (07) : 3692 - 3704
  • [22] Pixel-level signal modelling with spatial correlation for two-colour microarrays
    Ekstrom, Claus T.
    Bak, Soren
    Rudemo, Mats
    STATISTICAL APPLICATIONS IN GENETICS AND MOLECULAR BIOLOGY, 2005, 4
  • [23] The effect of pixel-level fusion on object tracking in multi-sensor surveillance video
    Cvejic, N.
    Nikolov, S. G.
    Knowles, H. D.
    Loza, A.
    Achim, A.
    Bull, D. R.
    Canagarajah, C. N.
    2007 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-8, 2007, : 3307 - +
  • [24] Siamese Dense Pixel-Level Fusion Network for Real-Time UAV Tracking
    Huang, Zhenyu
    Li, Gun
    Sun, Xudong
    Chen, Yong
    Sun, Jie
    Ni, Zhangsong
    Yang, Yang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (03): : 3219 - 3238
  • [25] Chaining Convolution and Correlation in Practice: a Case Study in Visual Tracking
    Ward, Dale A.
    Lee, Ivan
    Kearney, David A.
    Wong, Sebastien C.
    2013 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES & APPLICATIONS (DICTA), 2013, : 252 - 259
  • [26] Visual inspection of aircraft skin: Automated pixel-level defect detection by instance segmentation
    Meng DING
    Boer WU
    Juan XU
    Abdul Nasser KASULE
    Hongfu ZUO
    Chinese Journal of Aeronautics , 2022, (10) : 254 - 264
  • [27] Minimalistic fully convolution networks (MFCN): pixel-level classification for hyperspectral image with few labeled samples
    Xu, Buyun
    Hou, Weijun
    Wei, Yiwei
    Wang, Yiting
    Li, Xihai
    OPTICS EXPRESS, 2022, 30 (10) : 16585 - 16605
  • [28] Visual inspection of aircraft skin: Automated pixel-level defect detection by instance segmentation
    Ding, Meng
    Wu, Boer
    Xu, Juan
    Kasule, Abdul Nasser
    Zuo, Hongfu
    CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (10) : 254 - 264
  • [29] A fast and accurate tracking approach for automated visual surveillance
    Sánchez-Nielsen, E
    Hernández-Tejera, M
    39TH ANNUAL 2005 INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY, PROCEEDINGS, 2005, : 113 - 116
  • [30] Fast visual tracking with spatial phase correlation
    Zha, Yu-Fei
    Zhang, Li-Chao
    Qin, Bing
    Huang, Hong-Tu
    Guangzi Xuebao/Acta Photonica Sinica, 2015, 44 (07):