Motion-to-Matching: A Mixed Paradigm for 3D Single Object Tracking

被引:1
|
作者
Li, Zhiheng [1 ,2 ,3 ]
Lin, Yu [1 ]
Cui, Yubo [1 ]
Li, Shuo [1 ]
Fang, Zheng [1 ,2 ,3 ]
机构
[1] Northeastern Univ, Fac Robot Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang 110819, Peoples R China
[3] Northeastern Univ, Key Lab Data Analyt & Optimizat Smart Ind, Minist Educ, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Three-dimensional displays; Feature extraction; Point cloud compression; Transformers; Object tracking; Image matching; 3D object tracking; deep learning; point clouds;
D O I
10.1109/LRA.2023.3347143
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
3D single object tracking with LiDAR points is an important task in the computer vision field. Previous methods usually adopt the matching-based or motion-centric paradigms to estimate the current target status. However, the former is sensitive to the similar distractors and the sparseness of point clouds due to relying on appearance matching, while the latter usually focuses on short-term motion clues (eg. two frames) and ignores the long-term motion pattern of target. To address these issues, we propose a mixed paradigm with two stages, named MTM-Tracker, which combines motion modeling with feature matching into a single network. Specifically, in the first stage, we exploit the continuous historical boxes as motion prior and propose an encoder-decoder structure to locate target coarsely. Then, in the second stage, we introduce a feature interaction module to extract motion-aware features from consecutive point clouds and match them to refine target movement as well as regress other target states. Extensive experiments validate that our paradigm achieves competitive performance on large-scale datasets (70.9% in KITTI and 51.70% in NuScenes).
引用
收藏
页码:1468 / 1475
页数:8
相关论文
共 50 条
  • [41] Exploiting Segmentation for Robust 3D Object Matching
    Krainin, Michael
    Konolige, Kurt
    Fox, Dieter
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2012, : 4399 - 4405
  • [42] 3D cardiac motion tracking using Robust Point Matching and meshless deformable models
    Chen, Ting
    Wang, Xiaoxu
    Metaxas, Dimitris
    Axel, Leon
    2008 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1-4, 2008, : 280 - +
  • [43] A 3D motion controller for a tracking platform
    Grigore, O
    Grigore, O
    WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL XVII, PROCEEDINGS: CYBERNETICS AND INFORMATICS: CONCEPTS AND APPLICATIONS (PT II), 2001, : 434 - 439
  • [44] 3D motion tracking by Kalman filtering
    Gao, J
    Kosaka, A
    Kak, A
    INTERNET MULTIMEDIA MANAGEMENT SYSTEMS, 2000, 4210 : 162 - 170
  • [45] Robust object tracking techniques for vision-based 3D motion analysis applications
    Knyaz, Vladimir A.
    Zheltov, Sergey Yu.
    Vishnyakov, Boris V.
    OPTICS, PHOTONICS AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS IV, 2016, 9896
  • [46] Exploiting More Information in Sparse Point Cloud for 3D Single Object Tracking
    Cui, Yubo
    Shan, Jiayao
    Gu, Zuoxu
    Li, Zhiheng
    Fang, Zheng
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 11926 - 11933
  • [47] 3D Matching of Resource Vision Tracking Trajectories
    Konstantinou, Eirini
    Brilakis, Ioannis
    CONSTRUCTION RESEARCH CONGRESS 2016: OLD AND NEW CONSTRUCTION TECHNOLOGIES CONVERGE IN HISTORIC SAN JUAN, 2016, : 1742 - 1752
  • [48] 3D Single-Object Tracking with Spatial-Temporal Data Association
    Zhang, Yongchang
    Niu, Hanbing
    Guo, Yue
    He, Wenhao
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 264 - 269
  • [49] 3D Single-Object Tracking in Point Clouds with High Temporal Variation
    Wu, Qiao
    Sun, Kun
    An, Pei
    Salzmann, Mathieu
    Zhang, Yanning
    Yang, Jiaqi
    COMPUTER VISION-ECCV 2024, PT VII, 2025, 15065 : 279 - 296
  • [50] Manipulator and object tracking for in-hand 3D object modeling
    Krainin, Michael
    Henry, Peter
    Ren, Xiaofeng
    Fox, Dieter
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2011, 30 (11): : 1311 - 1327