3D Point Cloud Object Detection Algorithm Based on Temporal Information Fusion and Uncertainty Estimation

被引:0
|
作者
Xie, Guangda [1 ]
Li, Yang [2 ]
Wang, Yanping [2 ]
Li, Ziyi [1 ]
Qu, Hongquan [2 ]
机构
[1] North China Univ Technol, Coll Elect & Control Engn, Beijing 100144, Peoples R China
[2] North China Univ Technol, Coll Informat, Beijing 100144, Peoples R China
基金
中国国家自然科学基金;
关键词
point cloud; 3D object detection; GRU; positioning uncertainty;
D O I
10.3390/rs15122986
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In autonomous driving, LiDAR (light detection and ranging) data are acquired over time. Most existing 3D object detection algorithms propose the object bounding box by processing each frame of data independently, which ignores the temporal sequence information. However, the temporal sequence information is usually helpful to detect the object with missing shape information due to long distance or occlusion. To address this problem, we propose a temporal sequence information fusion 3D point cloud object detection algorithm based on the Ada-GRU (adaptive gated recurrent unit). In this method, the feature of each frame for the LiDAR point cloud is extracted through the backbone network and is fed to the Ada-GRU together with the hidden features of the previous frames. Compared to the traditional GRU, the Ada-GRU can adjust the gating mechanism adaptively during the training process by introducing the adaptive activation function. The Ada-GRU outputs the temporal sequence fusion features to predict the 3D object in the current frame and transmits the hidden features of the current frame to the next frame. At the same time, the label uncertainty of the distant and occluded objects affects the training effect of the model. For this problem, this paper proposes a probability distribution model of 3D bounding box coordinates based on the Gaussian distribution function and designs the corresponding bounding box loss function to enable the model to learn and estimate the uncertainty of the positioning of the bounding box coordinates, so as to remove the bounding box with large positioning uncertainty in the post-processing stage to reduce the false positive rate. Finally, the experiments show that the methods proposed in this paper improve the accuracy of the object detection without significantly increasing the complexity of the algorithm.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] 3D point cloud object detection algorithm based on Transformer
    Liu, Mingyang
    Yang, Qiming
    Hu, Guanhua
    Guo, Yan
    Zhang, Jiandong
    [J]. Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2023, 41 (06): : 1190 - 1197
  • [2] CenterTransFuser: radar point cloud and visual information fusion for 3D object detection
    Yan Li
    Kai Zeng
    Tao Shen
    [J]. EURASIP Journal on Advances in Signal Processing, 2023
  • [3] CenterTransFuser: radar point cloud and visual information fusion for 3D object detection
    Li, Yan
    Zeng, Kai
    Shen, Tao
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2023, 2023 (01)
  • [4] 3D Object Detection Based on Deep Semantics and Position Information Fusion of Laser Point Cloud
    Hu Jie
    An Yongpeng
    Xu Wencai
    Xiong Zongquan
    Liu Han
    [J]. CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2023, 50 (10):
  • [5] 3D Object Detection Based on Feature Fusion of Point Cloud Sequences
    Zhai, Zhenyu
    Wang, Qiantong
    Pan, Zongxu
    Hu, Wenlong
    Hu, Yuxin
    [J]. 2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 1240 - 1245
  • [6] Point Cloud 3D Object Detection Based on Improved SECOND Algorithm
    Zhang Ying
    Jiang Liangliang
    Zhang Dongbo
    Duan Wanlin
    Sun Yue
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (08)
  • [7] Point cloud 3D object detection method based on density information-local feature fusion
    Yanjie Chen
    Feng Xu
    Guodong Chen
    Zhiqiang Liang
    Jin Li
    [J]. Multimedia Tools and Applications, 2024, 83 : 2407 - 2425
  • [8] Point cloud 3D object detection method based on density information-local feature fusion
    Chen, Yanjie
    Xu, Feng
    Chen, Guodong
    Liang, Zhiqiang
    Li, Jin
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (1) : 2407 - 2425
  • [9] Research on 3D Object Detection Based on Laser Point Cloud and Image Fusion
    Liu, Yonggang
    Yu, Fengning
    Zhang, Xinjie
    Chen, Zheng
    Qin, Datong
    [J]. Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2022, 58 (24): : 289 - 299
  • [10] 3D object detection based on fusion of point cloud and image by mutual attention
    Chen, Jun-Ying
    Bai, Tong-Yao
    Zhao, Liang
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (09): : 2247 - 2254