3-D Vehicle Detection Enhancement Using Tracking Feedback in Sparse Point Clouds Environments

被引:4
|
作者
Qian, Yeqiang [1 ]
Wang, Xiaoliang [2 ,3 ]
Zhuang, Hanyang [4 ]
Wang, Chunxiang [2 ,3 ]
Yang, Ming [2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Global Inst Future Technol, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Automat, Shanghai, Peoples R China
[3] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ, Shanghai 200240, Peoples R China
[4] Shanghai Jiao Tong Univ, Univ Michigan Shanghai Jiao Tong Univ Joint Inst, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Three-dimensional displays; Proposals; Object detection; Vehicle detection; Feature extraction; Object tracking; tracking feedback; sparse point clouds;
D O I
10.1109/OJITS.2023.3283768
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, vehicle detection in intelligent transportation systems using 3D LIDAR point clouds based on deep neural networks has made substantial progress. However, when the point clouds are very sparse, the detection model cannot generate proposals efficiently, resulting in false negative results. Considering that the object tracking technology accurately predicts vehicles based on historical measurements and motion models, and these prediction results can become proposals for object detection. Therefore, this paper proposes a novel object detection paradigm based on tracking feedback to address the false negative problem based on sparse point clouds. According to the distribution of the state vector from the Kalman prediction, multiple proposals are sampled and fed back to the second stage of two-stage detection models. After regression and non-maximum suppression, the false negative results can be effectively reduced. This method enhances the vehicle detection capability of classical neural networks. Comparing the recall metric of multiple detection models at different distances in the public KITTI and nuSences datasets, the proposed method can promote up to 5.31% compared to the previous method, which reflects the effectiveness and versatility of the proposed method.
引用
收藏
页码:471 / 480
页数:10
相关论文
共 50 条
  • [1] Scale-Adaptive Pothole Detection and Tracking from 3-D Road Point Clouds
    Wu, Rigen
    Fan, Jiahe
    Guo, Libo
    Qiao, Lei
    Bhutta, M. Usman Maqbool
    Hosking, Brett
    Vityazev, Sergey
    Fan, Rui
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2021,
  • [2] PointTrackNet: An End-to-End Network For 3-D Object Detection and Tracking From Point Clouds
    Wang, Sukai
    Sun, Yuxiang
    Liu, Chengju
    Liu, Ming
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 3206 - 3212
  • [3] Automated detection of planes in 3-D point clouds using fast Hough transforms
    Ogundana, Olatokunbo O.
    Coggrave, C. Russell
    Burguete, Richard L.
    Huntley, Jonathan M.
    [J]. OPTICAL ENGINEERING, 2011, 50 (05)
  • [4] Semantic Consistency Reasoning for 3-D Object Detection in Point Clouds
    Wei, Wenwen
    Wei, Ping
    Liao, Zhimin
    Qin, Jialu
    Cheng, Xiang
    Liu, Meiqin
    Zheng, Nanning
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 14
  • [5] Sparse semantic map building and relocalization for UGV using 3D point clouds in outdoor environments
    Yan, Fei
    Wang, Jiawei
    He, Guojian
    Chang, Huan
    Zhuang, Yan
    [J]. NEUROCOMPUTING, 2020, 400 : 333 - 342
  • [6] Fast 3-D Urban Object Detection on Streaming Point Clouds
    Boercs, Attila
    Nagy, Balazs
    Benedek, Csaba
    [J]. COMPUTER VISION - ECCV 2014 WORKSHOPS, PT II, 2015, 8926 : 628 - 639
  • [7] Fast and Robust Keypoint Detection in Unstructured 3-D Point Clouds
    Garstka, Jens
    Peters, Gabriele
    [J]. ICIMCO 2015 PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL. 2, 2015, : 131 - 140
  • [8] Detection and 3-D positioning of small defects using 3-D point reconstruction, tracking, and the radiographic magnification technique
    Lindgren, Erik
    [J]. NDT & E INTERNATIONAL, 2015, 76 : 1 - 8
  • [9] Toward Accurate Road Detection in Challenging Environments Using 3D Point Clouds
    Byun, Jaemin
    Seo, Beom-Su
    Lee, Jihong
    [J]. ETRI JOURNAL, 2015, 37 (03) : 606 - 616
  • [10] Learning the Incremental Warp for 3D Vehicle Tracking in LiDAR Point Clouds
    Tian, Shengjing
    Liu, Xiuping
    Liu, Meng
    Bian, Yuhao
    Gao, Junbin
    Yin, Baocai
    [J]. REMOTE SENSING, 2021, 13 (14)