Motion-to-Matching: A Mixed Paradigm for 3D Single Object Tracking

被引:1
|
作者
Li, Zhiheng [1 ,2 ,3 ]
Lin, Yu [1 ]
Cui, Yubo [1 ]
Li, Shuo [1 ]
Fang, Zheng [1 ,2 ,3 ]
机构
[1] Northeastern Univ, Fac Robot Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang 110819, Peoples R China
[3] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Three-dimensional displays; Feature extraction; Point cloud compression; Transformers; Object tracking; Image matching; 3D object tracking; deep learning; point clouds;
D O I
10.1109/LRA.2023.3347143
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
3D single object tracking with LiDAR points is an important task in the computer vision field. Previous methods usually adopt the matching-based or motion-centric paradigms to estimate the current target status. However, the former is sensitive to the similar distractors and the sparseness of point clouds due to relying on appearance matching, while the latter usually focuses on short-term motion clues (eg. two frames) and ignores the long-term motion pattern of target. To address these issues, we propose a mixed paradigm with two stages, named MTM-Tracker, which combines motion modeling with feature matching into a single network. Specifically, in the first stage, we exploit the continuous historical boxes as motion prior and propose an encoder-decoder structure to locate target coarsely. Then, in the second stage, we introduce a feature interaction module to extract motion-aware features from consecutive point clouds and match them to refine target movement as well as regress other target states. Extensive experiments validate that our paradigm achieves competitive performance on large-scale datasets (70.9% in KITTI and 51.70% in NuScenes).
引用
收藏
页码:1468 / 1475
页数:8
相关论文
共 50 条
  • [31] 3D Siamese Transformer Network for Single Object Tracking on Point Clouds
    Hui, Le
    Wang, Lingpeng
    Tang, Linghua
    Lan, Kaihao
    Xie, Jin
    Yang, Jian
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 293 - 310
  • [32] 3D Object Tracking for Rough Models
    Song, Xiuqiang
    Xie, Weijian
    Li, Jiachen
    Wang, Nan
    Zhong, Fan
    Zhang, Guofeng
    Qin, Xueying
    COMPUTER GRAPHICS FORUM, 2023, 42 (07)
  • [33] Robust statistics for 3D object tracking
    Preisig, Peter
    Kragic, Danica
    2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-10, 2006, : 2403 - +
  • [34] A Framework for 3D Object Identification and Tracking
    Chliveros, Georgios
    Figueiredo, Rui P.
    Moreno, Plinio
    Pateraki, Maria
    Bernardino, Alexandre
    Santos-Victor, Jose
    Trahanias, Panos
    PROCEEDINGS OF THE 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, THEORY AND APPLICATIONS (VISAPP 2014), VOL 3, 2014, : 672 - 677
  • [35] Automatic model-based 3D object recognition by combining feature matching with tracking
    Sungho Kim
    In So Kweon
    Machine Vision and Applications, 2005, 16 : 267 - 272
  • [36] Automatic model-based 3D object recognition by combining feature matching with tracking
    Kim, S
    Kweon, IS
    MACHINE VISION AND APPLICATIONS, 2005, 16 (05) : 267 - 272
  • [37] Robust model-based 3D object recognition by combining feature matching with tracking
    Kim, S
    Kweon, I
    Kim, I
    2003 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-3, PROCEEDINGS, 2003, : 2123 - 2128
  • [38] Object-Centric Stereo Matching for 3D Object Detection
    Pon, Alex D.
    Ku, Jason
    Li, Chengyao
    Waslander, Steven L.
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 8383 - 8389
  • [39] 3D object matching using spherical mapping
    Mustafa, Blerim
    Davcev, Danco
    Trajkovik, Vladimir
    Kalajdziski, Slobodan
    IECON 2006 - 32ND ANNUAL CONFERENCE ON IEEE INDUSTRIAL ELECTRONICS, VOLS 1-11, 2006, : 1768 - +
  • [40] Parallel matching of 3D articulated object recognition
    Wang, PSP
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 1999, 13 (04) : 431 - 443