Deep Correlation Filter Tracking With Shepherded Instance-Aware Proposals

被引:4
|
作者
Liang, Yanjie [1 ]
Wu, Qiangqiang [2 ]
Liu, Yi [1 ]
Yan, Yan [1 ]
Wang, Hanzi [1 ]
机构
[1] Xiamen Univ, Sch Informat, Fujian Key Lab Sensing & Comp Smart City, Xiamen 361005, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Proposals; Correlation; Feature extraction; Image edge detection; Distortion; Task analysis; Deep correlation filters; color and edge cues; multi-layer target-specific deep features; shepherded instance-aware proposals; VISUAL TRACKING; ROBUST; SCALE;
D O I
10.1109/TITS.2021.3103601
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Visual tracking is a core component of intelligent transportation systems and it is crucial to reduce or avoid traffic accidents. Recently, deep correlation filter (DCF) based trackers have exhibited good tracking performance. However, existing DCF based trackers are still ineffective to cope with large scale variations and severe distortions (e.g., heavy occlusions, significant deformations, large rotations, etc.), leading to the inferior performance. To address these issues, we develop a novel DeepCFIAP++ tracker, which incorporates effective shepherded instance-aware proposals into DCFs. DeepCFIAP++ can not only estimate the target scale at every frame but also re-detect the target in the case of severe distortions. Firstly, we propose to exploit both color and edge cues to generate complementary detection proposals to effectively handle various challenging scenarios. Then, we propose to utilize multi-layer target-specific deep features to rank the generated detection proposals and choose the instance-aware proposals, which will result in more robust tracking performance. Finally, we propose to use the DCFs to shepherd the instance-aware proposals toward their best locations, which will result in more accurate tracking results. Experimental results on five challenging datasets (i.e., OTB2013, OTB2015, VOT2016, VOT2017 and UAV20L) demonstrate that DeepCFIAP++ performs competitively with several other state-of-the-art DCF based trackers.
引用
收藏
页码:11408 / 11421
页数:14
相关论文
共 50 条
  • [1] Robust Correlation Filter Tracking with Shepherded Instance-Aware Proposals
    Liang, Yanjie
    Wu, Qiangqiang
    Liu, Yi
    Yan, Yan
    Wang, Hanzi
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 420 - 428
  • [2] Instance-aware Image Colorization
    Su, Jheng-Wei
    Chu, Hung-Kuo
    Huang, Jia-Bin
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 7965 - 7974
  • [3] Instance-aware image dehazing
    Chao, Qingqing
    Yan, Jinqiang
    Sun, Tianmeng
    Li, Silong
    Chi, Jieru
    Yang, Guowei
    Chen, Chenglizhao
    Yu, Teng
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [4] Instance-Aware Scene Layout Forecasting
    Qiao, Xiaotian
    Zheng, Quanlong
    Cao, Ying
    Lau, Rynson W. H.
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (02) : 504 - 516
  • [5] Instance-Aware Scene Layout Forecasting
    Xiaotian Qiao
    Quanlong Zheng
    Ying Cao
    Rynson W. H. Lau
    International Journal of Computer Vision, 2022, 130 : 504 - 516
  • [6] Instance-Aware Deep Graph Learning for Multi-Label Classification
    Wang, Yun
    Zhang, Tong
    Zhou, Chuanwei
    Cui, Zhen
    Yang, Jian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 90 - 99
  • [7] Instance-aware representation learning and association for online multi-person tracking
    Wu, Hefeng
    Hu, Yafei
    Wang, Keze
    Li, Hanhui
    Nie, Lin
    Cheng, Hui
    PATTERN RECOGNITION, 2019, 94 : 25 - 34
  • [8] Indoor Instance-Aware Semantic Mapping Using Instance Segmentation
    Jiang, Yinpeng
    Ma, Xudong
    Fang, Fang
    Kang, Xuewen
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 3549 - 3554
  • [9] Instance-aware Detailed Action Labeling in Videos
    Yang, Hongtao
    He, Xuming
    Porikli, Fatih
    2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 1623 - 1632
  • [10] The Instance-Aware Automatic Image Colorization Based on Deep Convolutional Neural Network
    Li, Hui
    Zeng, Wei
    Xiao, Guorong
    Wang, Huabin
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2020, 26 (04): : 841 - 846