Deep Correlation Filter Tracking With Shepherded Instance-Aware Proposals

被引:4
|
作者
Liang, Yanjie [1 ]
Wu, Qiangqiang [2 ]
Liu, Yi [1 ]
Yan, Yan [1 ]
Wang, Hanzi [1 ]
机构
[1] Xiamen Univ, Sch Informat, Fujian Key Lab Sensing & Comp Smart City, Xiamen 361005, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Proposals; Correlation; Feature extraction; Image edge detection; Distortion; Task analysis; Deep correlation filters; color and edge cues; multi-layer target-specific deep features; shepherded instance-aware proposals; VISUAL TRACKING; ROBUST; SCALE;
D O I
10.1109/TITS.2021.3103601
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Visual tracking is a core component of intelligent transportation systems and it is crucial to reduce or avoid traffic accidents. Recently, deep correlation filter (DCF) based trackers have exhibited good tracking performance. However, existing DCF based trackers are still ineffective to cope with large scale variations and severe distortions (e.g., heavy occlusions, significant deformations, large rotations, etc.), leading to the inferior performance. To address these issues, we develop a novel DeepCFIAP++ tracker, which incorporates effective shepherded instance-aware proposals into DCFs. DeepCFIAP++ can not only estimate the target scale at every frame but also re-detect the target in the case of severe distortions. Firstly, we propose to exploit both color and edge cues to generate complementary detection proposals to effectively handle various challenging scenarios. Then, we propose to utilize multi-layer target-specific deep features to rank the generated detection proposals and choose the instance-aware proposals, which will result in more robust tracking performance. Finally, we propose to use the DCFs to shepherd the instance-aware proposals toward their best locations, which will result in more accurate tracking results. Experimental results on five challenging datasets (i.e., OTB2013, OTB2015, VOT2016, VOT2017 and UAV20L) demonstrate that DeepCFIAP++ performs competitively with several other state-of-the-art DCF based trackers.
引用
收藏
页码:11408 / 11421
页数:14
相关论文
共 50 条
  • [11] Fully Convolutional Instance-aware Semantic Segmentation
    Li, Yi
    Qi, Haozhi
    Dai, Jifeng
    Ji, Xiangyang
    Wei, Yichen
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4438 - 4446
  • [12] Online Multi-Object Tracking with Instance-Aware Tracker and Dynamic Model Refreshment
    Chu, Peng
    Fan, Heng
    Tan, Chiu C.
    Ling, Haibin
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 161 - 170
  • [13] InstaNAS: Instance-Aware Neural Architecture Search
    Cheng, An-Chieh
    Lin, Chieh Hubert
    Juan, Da-Cheng
    Wei, Wei
    Sun, Min
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3577 - 3584
  • [14] SOIT: Segmenting Objects with Instance-Aware Transformers
    Yu, Xiaodong
    Shi, Dahu
    Wei, Xing
    Ren, Ye
    Ye, Tingqun
    Tan, Wenming
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3188 - 3196
  • [15] Instance-Aware Dynamic Neural Network Quantization
    Liu, Zhenhua
    Wang, Yunhe
    Han, Kai
    Ma, Siwei
    Gao, Wen
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12424 - 12433
  • [16] Correction to: Instance-Aware Scene Layout Forecasting
    Xiaotian Qiao
    Quanlong Zheng
    Ying Cao
    Rynson W. H. Lau
    International Journal of Computer Vision, 2022, 130 (3) : 883 - 883
  • [17] Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation
    Lei, Xiaohan
    Wang, Min
    Zhou, Wengang
    Li, Li
    Li, Houqiang
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 16329 - 16339
  • [18] Hybrid Instance-Aware Temporal Fusion for Online Video Instance Segmentation
    Li, Xiang
    Wang, Jinglu
    Li, Xiao
    Lu, Yan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1429 - 1437
  • [19] INSTANCE-AWARE UNCERTAINTY FOR ACTIVE LEARNING IN OBJECT DETECTION
    Zhang, Zhipeng
    Ma, Wenting
    Yuan, Xiaohang
    Hao, Yuan
    Guo, Meng
    Tang, Hongyi
    Zhou, Zhiheng
    Yao, Zhenjie
    2024 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2024, : 298 - 304
  • [20] Weakly supervised segmentation via instance-aware propagation
    Huang, Xin
    Zhu, Qianshu
    Liu, Yongtuo
    He, Shengfeng
    NEUROCOMPUTING, 2021, 447 : 1 - 9