Visual object tracking based on residual network and cascaded correlation filters

被引:145
|
作者
Zhang, Jianming [1 ]
Sun, Juan [1 ]
Wang, Jin [1 ]
Yue, Xiao-Guang [2 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Hunan Prov Key Lab Intelligent Proc Big Data Tran, Changsha 410114, Peoples R China
[2] Rajamangala Univ Technol Rattanakosin, Rattanakosin Int Coll Creat Entrepreneurship, Nakhon Pathom 73170, Thailand
基金
中国国家自然科学基金;
关键词
Object tracking; Deep learning; Residual network; Resnet features; Cascaded correlation filters; ALGORITHM;
D O I
10.1007/s12652-020-02572-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Significant progress is made in the field of object tracking recently. Especially, trackers based on deep learning and correlation filters both have achieved excellent performance. However, object tracking still faces some challenging problems such as deformation and illumination. In such kinds of situations, the accuracy and precision of tracking algorithms plunge as a result. It is imminent to find a solution to this situation. In this paper, we propose a tracking algorithm based on features extracted by residual network called Resnet features and cascaded correlation filters to improve precision and accuracy. Firstly, features extracted by a deep residual network trained on other image processing datasets, are robust enough and retain higher resolution, therefore, we exploit Resnet-101 pretrained offline to obtain features extracted by middle and high layers for target appearance model representation. Resnet-101 is deeper compared with other deep neural networks which means it contains more semantic information. Then, the method we propose to combine our correlation filters is superior. We propose cascaded correlation filters generated by handcraft, middle-level and high-level features from residual network to gain better competence. Handcraft features localize target precisely because they contain more spatial details while Resnet features are robust to the target appearance change because they retain more semantic information. Finally, we conduct extensive experiments on OTB2013 and OTB2015 benchmark. The experimental results show that our tracker achieves high performance under all kinds of challenges and performs favorably against other state-of-the-art trackers.
引用
收藏
页码:8427 / 8440
页数:14
相关论文
共 50 条
  • [11] Object Tracking Based on Vector Convolutional Network and Discriminant Correlation Filters
    Liu, Yuan
    Sui, Xiubao
    Kuang, Xiaodong
    Liu, Chengwei
    Gu, Guohua
    Chen, Qian
    SENSORS, 2019, 19 (08)
  • [12] Complementary Discriminative Correlation Filters Based on Collaborative Representation for Visual Object Tracking
    Zhu, Xue-Feng
    Wu, Xiao-Jun
    Xu, Tianyang
    Feng, Zhen-Hua
    Kittler, Josef
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) : 557 - 568
  • [13] Channel Graph Regularized Correlation Filters for Visual Object Tracking
    Jain, Monika
    Tyagi, Arjun
    Subramanyam, A., V
    Denman, Simon
    Sridharan, Sridha
    Fookes, Clinton
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) : 715 - 729
  • [14] DCFNet: Discriminant Correlation Filters Network for Visual Tracking
    Hu, Wei-Ming
    Wang, Qiang
    Gao, Jin
    Li, Bing
    Maybank, Stephen
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2024, 39 (03) : 691 - 714
  • [15] A Visual Object Tracking Algorithm Based on Features Extracted by Deep Residual Network
    Ma S.-G.
    Zhao X.-M.
    Hou Z.-Q.
    Wang Z.-M.
    Sun H.-L.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2020, 43 (02): : 129 - 134
  • [16] Correlation Filters Based on Multi-Expert and Game Theory for Visual Object Tracking
    Ma, Sugang
    Zhao, Zhixian
    Hou, Zhiqiang
    Zhang, Lei
    Yang, Xiaobao
    Pu, Lei
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [17] Adaptive Spatial-Temporal Regularization for Correlation Filters Based Visual Object Tracking
    Chen, Fei
    Wang, Xiaodong
    SYMMETRY-BASEL, 2021, 13 (09):
  • [18] Augmenting cascaded correlation filters with spatial-temporal saliency for visual tracking
    Zhao, Dawei
    Xiao, Liang
    Fu, Hao
    Wu, Tao
    Xu, Xin
    Dai, Bin
    INFORMATION SCIENCES, 2019, 470 : 78 - 93
  • [19] Learning Rotation Adaptive Correlation Filters in Robust Visual Object Tracking
    Rout, Litu
    Raju, Priya Mariam
    Mishra, Deepak
    Gorthi, Rama Krishna Sai Subrahmanyam
    COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 646 - 661
  • [20] Fast Spatially-Regularized Correlation Filters for Visual Object Tracking
    Zhang, Pengyu
    Guo, Qing
    Feng, Wei
    PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 57 - 70