Track to Detect and Segment: An Online Multi-Object Tracker

被引:212
|
作者
Wu, Jialian [1 ]
Cao, Jiale [2 ]
Song, Liangchen [1 ]
Wang, Yu [3 ]
Yang, Ming [3 ]
Yuan, Junsong [1 ]
机构
[1] SUNY Buffalo, Buffalo, NY 14260 USA
[2] TJU, Tianjin, Peoples R China
[3] Horizon Robot, Beijing, Peoples R China
基金
美国国家科学基金会;
关键词
D O I
10.1109/CVPR46437.2021.01217
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most online multi-object trackers perform object detection stand-alone in a neural net without any input from tracking. In this paper, we present a new online joint detection and tracking model, TraDeS (TRAck to DEtect and Segment), exploiting tracking clues to assist detection end-to-end. TraDeS infers object tracking offset by a cost volume, which is used to propagate previous object features for improving current object detection and segmentation. Effectiveness and superiority of TraDeS are shown on 4 datasets, including MOT (2D tracking), nuScenes (3D tracking), MOTS and Youtube-VIS (instance segmentation tracking).
引用
收藏
页码:12347 / 12356
页数:10
相关论文
共 50 条
  • [41] Multi-object tracking with discriminant correlation filter based deep learning tracker
    Yang, Tao
    Cappelle, Cindy
    Ruichek, Yassine
    El Bagdouri, Mohammed
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2019, 26 (03) : 273 - 284
  • [42] Design of Improved ECO Multi-Object Tracker Based on Camera Motion Estimation
    Chen, Jianchao
    Xi, Zhenghao
    Liu, Xiang
    Computer Engineering and Applications, 2024, 60 (10) : 285 - 291
  • [43] Consensus-based Distributed Variational Multi-object Tracker in Multi-Sensor Network
    Li, Qing
    Gan, Runze
    Godsill, Simon
    2023 SENSOR SIGNAL PROCESSING FOR DEFENCE CONFERENCE, SSPD, 2023, : 56 - 60
  • [44] Object-aware bounding box regression for online multi-object tracking
    Li, Hongli
    Dong, Yongsheng
    Li, Xuelong
    NEUROCOMPUTING, 2023, 518 : 440 - 452
  • [45] Online learning of Cascaded Classifier Designed for Multi-object Tracking
    Lin Yimin
    Lu Naiguang
    Lou Xiaoping
    Li Lili
    Zou Fang
    Yao Yanbin
    Du Zhaocai
    PROCEEDINGS OF 2013 IEEE 11TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), 2013, : 1045 - 1051
  • [46] Online Visual Multi-object Tracking Based on Fuzzy Logic
    Li, Liang-qun
    Luo, Sheng
    Li, Jun
    2016 12TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2016, : 1001 - 1005
  • [47] AttTrack: Online Deep Attention Transfer for Multi-object Tracking
    Nalaie, Keivan
    Zheng, Rong
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 1654 - 1663
  • [48] Online Min Cost Circulation for Multi-Object Tracking on Fragments
    Wang, Yanbing
    Ji, Junyi
    Barbour, William
    Work, Daniel B.
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 2803 - 2810
  • [49] Online Multi-Object Tracking Based on Global and Local Features
    Xu, Liang
    Li, Weihai
    Wu, Huiling
    Li, Qiang
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [50] AIPT: Adaptive information perception for online multi-object tracking
    Zhang, Yukuan
    Xie, Housheng
    Jia, Yunhua
    Meng, Jingrui
    Sang, Meng
    Qiu, Junhui
    Zhao, Shan
    Yang, Yang
    KNOWLEDGE-BASED SYSTEMS, 2024, 285