Deep Correlation Filter Tracking With Shepherded Instance-Aware Proposals

被引:4
|
作者
Liang, Yanjie [1 ]
Wu, Qiangqiang [2 ]
Liu, Yi [1 ]
Yan, Yan [1 ]
Wang, Hanzi [1 ]
机构
[1] Xiamen Univ, Sch Informat, Fujian Key Lab Sensing & Comp Smart City, Xiamen 361005, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Proposals; Correlation; Feature extraction; Image edge detection; Distortion; Task analysis; Deep correlation filters; color and edge cues; multi-layer target-specific deep features; shepherded instance-aware proposals; VISUAL TRACKING; ROBUST; SCALE;
D O I
10.1109/TITS.2021.3103601
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Visual tracking is a core component of intelligent transportation systems and it is crucial to reduce or avoid traffic accidents. Recently, deep correlation filter (DCF) based trackers have exhibited good tracking performance. However, existing DCF based trackers are still ineffective to cope with large scale variations and severe distortions (e.g., heavy occlusions, significant deformations, large rotations, etc.), leading to the inferior performance. To address these issues, we develop a novel DeepCFIAP++ tracker, which incorporates effective shepherded instance-aware proposals into DCFs. DeepCFIAP++ can not only estimate the target scale at every frame but also re-detect the target in the case of severe distortions. Firstly, we propose to exploit both color and edge cues to generate complementary detection proposals to effectively handle various challenging scenarios. Then, we propose to utilize multi-layer target-specific deep features to rank the generated detection proposals and choose the instance-aware proposals, which will result in more robust tracking performance. Finally, we propose to use the DCFs to shepherd the instance-aware proposals toward their best locations, which will result in more accurate tracking results. Experimental results on five challenging datasets (i.e., OTB2013, OTB2015, VOT2016, VOT2017 and UAV20L) demonstrate that DeepCFIAP++ performs competitively with several other state-of-the-art DCF based trackers.
引用
收藏
页码:11408 / 11421
页数:14
相关论文
共 50 条
  • [41] Artistic Instance-Aware Image Filtering by Convolutional Neural Networks
    Tehrani, Milad
    Bagheri, Mahnoosh
    Ahmadi, Mahdi
    Norouzi, Alireza
    Karimi, Nader
    Samavi, Shadrokh
    2018 9TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2018, : 710 - 714
  • [42] Instance-aware Image and Sentence Matching with Selective Multimodal LSTM
    Huang, Yan
    Wang, Wei
    Wang, Liang
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 7254 - 7262
  • [43] INSTANCE-AWARE SIMPLIFICATION OF 3D POLYGONAL MESHES
    Azim, Tahir
    Cheslack-Postava, Ewen
    Levis, Philip
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2015,
  • [44] Joint EM Image Denoising and Segmentation with Instance-Aware Interaction
    Wang, Zhicheng
    Li, Jiacheng
    Chen, Yinda
    Shou, Jiateng
    Deng, Shiyu
    Huang, Wei
    Xiong, Zhiwei
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VII, 2024, 15007 : 403 - 413
  • [45] Usiigaci: Instance-aware cell tracking in stain-free phase contrast microscopy enabled by machine learning
    Tsai, Hsieh-Fu
    Gajda, Joanna
    Sloan, Tyler F. W.
    Rares, Andrei
    Shen, Amy Q.
    SOFTWAREX, 2019, 9 : 230 - 237
  • [46] Self-Guided Instance-Aware Network for Depth Completion and Enhancement
    Luo, Zhongzhen
    Zhang, Fengjia
    Fu, Guoyi
    Xu, Jiajie
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 10905 - 10911
  • [47] INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold
    Lee, Changhun
    Kim, Hyungjun
    Park, Eunhyeok
    Kim, Jae-Joon
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17279 - 17288
  • [48] InstaSAM: Instance-Aware Segment Any Nuclei Model with Point Annotations
    Nam, Siwoo
    Namgung, Hyun
    Jeong, Jaehoon
    Luna, Miguel
    Kim, Soopil
    Chikontwe, Philip
    Park, Sang Hyun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT IV, 2024, 15004 : 232 - 242
  • [49] Learning instance-aware object detection using determinantal point processes
    Kim, Nuri
    Lee, Donghoon
    Oh, Songhwai
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 201
  • [50] Mitigating Forgetting in Online Continual Learning via Instance-Aware Parameterization
    Chen, Hung-Jen
    Cheng, An-Chieh
    Juan, Da-Cheng
    Wei, Wei
    Sun, Min
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33