Deep Correlation Filter Tracking With Shepherded Instance-Aware Proposals

被引:4
|
作者
Liang, Yanjie [1 ]
Wu, Qiangqiang [2 ]
Liu, Yi [1 ]
Yan, Yan [1 ]
Wang, Hanzi [1 ]
机构
[1] Xiamen Univ, Sch Informat, Fujian Key Lab Sensing & Comp Smart City, Xiamen 361005, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Proposals; Correlation; Feature extraction; Image edge detection; Distortion; Task analysis; Deep correlation filters; color and edge cues; multi-layer target-specific deep features; shepherded instance-aware proposals; VISUAL TRACKING; ROBUST; SCALE;
D O I
10.1109/TITS.2021.3103601
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Visual tracking is a core component of intelligent transportation systems and it is crucial to reduce or avoid traffic accidents. Recently, deep correlation filter (DCF) based trackers have exhibited good tracking performance. However, existing DCF based trackers are still ineffective to cope with large scale variations and severe distortions (e.g., heavy occlusions, significant deformations, large rotations, etc.), leading to the inferior performance. To address these issues, we develop a novel DeepCFIAP++ tracker, which incorporates effective shepherded instance-aware proposals into DCFs. DeepCFIAP++ can not only estimate the target scale at every frame but also re-detect the target in the case of severe distortions. Firstly, we propose to exploit both color and edge cues to generate complementary detection proposals to effectively handle various challenging scenarios. Then, we propose to utilize multi-layer target-specific deep features to rank the generated detection proposals and choose the instance-aware proposals, which will result in more robust tracking performance. Finally, we propose to use the DCFs to shepherd the instance-aware proposals toward their best locations, which will result in more accurate tracking results. Experimental results on five challenging datasets (i.e., OTB2013, OTB2015, VOT2016, VOT2017 and UAV20L) demonstrate that DeepCFIAP++ performs competitively with several other state-of-the-art DCF based trackers.
引用
收藏
页码:11408 / 11421
页数:14
相关论文
共 50 条
  • [31] MARS: An Instance-Aware, Modular and Realistic Simulator for Autonomous Driving
    Wu, Zirui
    Liu, Tianyu
    Luo, Liyi
    Zhong, Zhide
    Chen, Jianteng
    Xiao, Hongmin
    Hou, Chao
    Lou, Haozhe
    Chen, Yuantao
    Yang, Runyi
    Huang, Yuxin
    Ye, Xiaoyu
    Yan, Zike
    Shi, Yongliang
    Liao, Yiyi
    Zhao, Hao
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT I, 2024, 14473 : 3 - 15
  • [32] Object Tracking in Unmanned Aerial Vehicle Videos via Multifeature Discrimination and Instance-Aware Attention Network
    Zhang, Shiyu
    Zhuo, Li
    Zhang, Hui
    Li, Jiafeng
    REMOTE SENSING, 2020, 12 (16)
  • [33] Context-Aware Correlation Filter Tracking
    Mueller, Matthias
    Smith, Neil
    Ghanem, Bernard
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1387 - 1395
  • [34] Distracter-Aware Correlation Filter Tracking
    Lu, Xiaohuan
    He, Zhenyu
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 19 - 24
  • [35] Instance-aware Contrastive Learning for Occluded Human Mesh Reconstruction
    Gwon, Mi-Gyeong
    Um, Gi-Mun
    Cheong, Won-Sik
    Kim, Wonjun
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 10553 - 10562
  • [36] InsMOS: Instance-Aware Moving Object Segmentation in LiDAR Data
    Wang, Neng
    Shi, Chenghao
    Guo, Ruibin
    Lu, Huimin
    Zheng, Zhiqiang
    Chen, Xieyuanli
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7598 - 7605
  • [37] Instance-Aware Predictive Navigation in Multi-Agent Environments
    Cao, Jinkun
    Wang, Xin
    Darrell, Trevor
    Yu, Fisher
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 5096 - 5102
  • [38] InstaFormer: Instance-Aware Image-to-Image Translation with Transformer
    Kim, Soohyun
    Baek, Jongbeom
    Park, Jihye
    Kim, Gyeongnyeon
    Kim, Seungryong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18300 - 18310
  • [39] Instance-Aware Hashing for Multi-Label Image Retrieval
    Lai, Hanjiang
    Yan, Pan
    Shu, Xiangbo
    Wei, Yunchao
    Yan, Shuicheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (06) : 2469 - 2479
  • [40] Progressive Instance-Aware Feature Learning for Compositional Action Recognition
    Yan, Rui
    Xie, Lingxi
    Shu, Xiangbo
    Zhang, Liyan
    Tang, Jinhui
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 10317 - 10330