3D Point Cloud Object Detection Algorithm Based on Temporal Information Fusion and Uncertainty Estimation

被引:0
|
作者
Xie, Guangda [1 ]
Li, Yang [2 ]
Wang, Yanping [2 ]
Li, Ziyi [1 ]
Qu, Hongquan [2 ]
机构
[1] North China Univ Technol, Coll Elect & Control Engn, Beijing 100144, Peoples R China
[2] North China Univ Technol, Coll Informat, Beijing 100144, Peoples R China
基金
中国国家自然科学基金;
关键词
point cloud; 3D object detection; GRU; positioning uncertainty;
D O I
10.3390/rs15122986
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In autonomous driving, LiDAR (light detection and ranging) data are acquired over time. Most existing 3D object detection algorithms propose the object bounding box by processing each frame of data independently, which ignores the temporal sequence information. However, the temporal sequence information is usually helpful to detect the object with missing shape information due to long distance or occlusion. To address this problem, we propose a temporal sequence information fusion 3D point cloud object detection algorithm based on the Ada-GRU (adaptive gated recurrent unit). In this method, the feature of each frame for the LiDAR point cloud is extracted through the backbone network and is fed to the Ada-GRU together with the hidden features of the previous frames. Compared to the traditional GRU, the Ada-GRU can adjust the gating mechanism adaptively during the training process by introducing the adaptive activation function. The Ada-GRU outputs the temporal sequence fusion features to predict the 3D object in the current frame and transmits the hidden features of the current frame to the next frame. At the same time, the label uncertainty of the distant and occluded objects affects the training effect of the model. For this problem, this paper proposes a probability distribution model of 3D bounding box coordinates based on the Gaussian distribution function and designs the corresponding bounding box loss function to enable the model to learn and estimate the uncertainty of the positioning of the bounding box coordinates, so as to remove the bounding box with large positioning uncertainty in the post-processing stage to reduce the false positive rate. Finally, the experiments show that the methods proposed in this paper improve the accuracy of the object detection without significantly increasing the complexity of the algorithm.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] 3D point filtering algorithm for 3d object detection based on stereo image processing
    Kim, Jong-Min
    Park, Jeong-Min
    Lee, Joon-Woong
    [J]. Journal of Institute of Control, Robotics and Systems, 2021, 27 (09) : 676 - 684
  • [42] GNN-based Point Cloud Maps Feature Extraction and Residual Feature Fusion for 3D Object Detection
    Liao, Wei-Hsiang
    Wang, Chieh-Chih
    Lin, Wen-Chieh
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 7010 - 7016
  • [43] SCNet: Subdivision Coding Network for Object Detection Based on 3D Point Cloud
    Wang, Zhiyu
    Fu, Hao
    Wang, Li
    Xiao, Liang
    Dai, Bin
    [J]. IEEE ACCESS, 2019, 7 : 120449 - 120462
  • [44] Adaptive learning point cloud and image diversity feature fusion network for 3D object detection
    Yan, Weiqing
    Liu, Shile
    Liu, Hao
    Yue, Guanghui
    Wang, Xuan
    Song, Yongchao
    Xu, Jindong
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (02) : 2825 - 2837
  • [45] Adaptive learning point cloud and image diversity feature fusion network for 3D object detection
    Weiqing Yan
    Shile Liu
    Hao Liu
    Guanghui Yue
    Xuan Wang
    Yongchao Song
    Jindong Xu
    [J]. Complex & Intelligent Systems, 2024, 10 : 2825 - 2837
  • [46] Query-based Temporal Fusion with Explicit Motion for 3D Object Detection
    Hou, Jinghua
    Liu, Zhe
    Liang, Dingkang
    Zou, Zhikang
    Ye, Xiaoqing
    Bai, Xiang
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [47] Enhancing Point Features with Spatial Information for Point-Based 3D Object Detection
    Liu, Huaijin
    Du, Jixiang
    Zhang, Yong
    Zhang, Hongbo
    [J]. SCIENTIFIC PROGRAMMING, 2021, 2021
  • [48] Kalman-Based Scene Flow Estimation for Point Cloud Densification and 3D Object Detection in Dynamic Scenes
    Ding, Junzhe
    Zhang, Jin
    Ye, Luqin
    Wu, Cheng
    [J]. SENSORS, 2024, 24 (03)
  • [49] Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud
    Guo, Jianwei
    Xing, Xuejun
    Quan, Weize
    Yan, Dong-Ming
    Gu, Qingyi
    Liu, Yang
    Zhang, Xiaopeng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5072 - 5084
  • [50] 3D OBJECT DETECTION NETWORK COMBINED WITH POINT CLOUD COMPLETION
    Zhou, Jing
    Yu, Chao
    Zhang, Junchi
    Hu, Yiyu
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2024, 25 (05) : 789 - 809